-- Logs begin at Fri 2021-08-27 03:51:59 UTC, end at Fri 2021-08-27 05:34:38 UTC. -- Aug 27 04:23:45.577672 dv-cinder-778193-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 27 04:23:45.587840 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 04:23:45 2021] *** Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: nodename: dv-cinder-778193-4-iscsi Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: machine: x86_64 Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: clock source: unix Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: pcre jit disabled Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: detected number of CPU cores: 4 Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: current working directory: / Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: detected binary path: /usr/bin/uwsgi-core Aug 27 04:23:45.589825 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: your processes number limit is 47680 Aug 27 04:23:45.590534 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: your memory page size is 4096 bytes Aug 27 04:23:45.590534 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: detected max file descriptor number: 2048 Aug 27 04:23:45.590534 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: lock engine: pthread robust mutexes Aug 27 04:23:45.590534 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: thunder lock: enabled Aug 27 04:23:45.590534 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 27 04:23:45.590534 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 04:23:45.636117 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: Python main interpreter initialized at 0x561f873909c0 Aug 27 04:23:45.636117 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: python threads support enabled Aug 27 04:23:45.636117 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: your server socket listen backlog is limited to 100 connections Aug 27 04:23:45.636117 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: your mercy for graceful operations on workers is 90 seconds Aug 27 04:23:45.636586 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 04:23:45.636586 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: *** Operational MODE: preforking *** Aug 27 04:23:45.636895 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: *** uWSGI is running in multiple interpreter mode *** Aug 27 04:23:45.636895 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: spawned uWSGI master process (pid: 73660) Aug 27 04:23:45.637115 dv-cinder-778193-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 27 04:23:45.643448 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: spawned uWSGI worker 1 (pid: 73667, cores: 1) Aug 27 04:23:45.643448 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: spawned uWSGI worker 2 (pid: 73668, cores: 1) Aug 27 04:23:45.643448 dv-cinder-778193-4-iscsi devstack@keystone.service[73660]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 04:23:50.684692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:23:50.684692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: from cryptography.utils import int_from_bytes Aug 27 04:23:50.685455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:23:50.685455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: from cryptography.utils import int_from_bytes Aug 27 04:23:50.685900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:23:50.685900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: from cryptography.utils import int_from_bytes Aug 27 04:23:50.686030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:23:50.686030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: from cryptography.utils import int_from_bytes Aug 27 04:23:50.734247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:23:50.734437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:23:50.734631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] command line args: [] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:23:50.734747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:23:50.734911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:23:50.734995 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:23:50.735077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ================================================================================ {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:23:50.735153 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] command line args: [] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:23:50.735333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] admin_token = **** {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.735412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:23:50.735552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ================================================================================ {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:23:50.735636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] config_dir = [] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.735784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.735856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] admin_token = **** {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.735924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] config_source = [] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.736039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] config_dir = [] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.736116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] debug = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.736229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.736314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.737594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] config_source = [] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.737594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] debug = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.737824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.737824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738515 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] list_limit = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] log_config_append = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.738961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] list_limit = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.739079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] log_dir = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.739158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] log_config_append = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.739276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] log_file = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.739355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.739474 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.739548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] log_dir = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.739548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] log_file = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.739735 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.739854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.739933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.740050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.740124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.740124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.740316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.740471 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.740548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.740661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.740746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.740746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.740916 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.741028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.741101 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.741101 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.741359 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.741479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.741558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.741623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.741685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742290 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742368 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] publish_errors = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.742882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] publish_errors = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743283 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743424 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743654 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] standard_threads = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.743972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.744121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.744196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.744373 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] standard_threads = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.744464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.744541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.744609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.744718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] use_journal = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.744840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.744917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] use_json = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.745019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.745102 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] use_stderr = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.745198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] use_journal = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.745274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] use_syslog = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.745378 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] use_json = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.745458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.745556 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] use_stderr = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.745670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.745777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] use_syslog = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.745909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.745992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:23:50.746167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.746244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.746405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.746487 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.746666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.746758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.746909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.747057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.747139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.747219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.747380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.747460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.747624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.747707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.747869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.748719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.748719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.748968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.749088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.749214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.749358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.749487 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.749613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.749740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.749863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.749999 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.750130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.750253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.750374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.750500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.750586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.750755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.750879 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.751005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.751126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.751251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.751372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.751564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.751693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.751796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.751880 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752000 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752424 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752859 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.752991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753400 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753681 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.753941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.754085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.754167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.754319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.754401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.754571 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.754664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.754782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.754860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.755012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.755089 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.755242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.755318 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.755522 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.755617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.755719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.755797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.755955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.756031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.756183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.756262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.756442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.756523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.756674 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.756750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.756910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.756995 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.757144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.757223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.757390 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.758065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.758158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.758231 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.758385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.758468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.758620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.758698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.758854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.758937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.759088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.759164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.759322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.759400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.759551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.759629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.759789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.759865 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.760018 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.760099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.760256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.760335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.760512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.760591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.760753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.760837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.760997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.761081 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.761216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.761293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.761452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.761530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.761686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.761772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.761921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.761998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.762161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.762237 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.762404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.762481 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.762638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.762715 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.762882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.762958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.763117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.763193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.763348 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.763424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.763589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.763665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.763822 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.763901 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.764051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.764138 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.764286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.764547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.764639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.764786 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.764862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.765048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.765126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.765284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.765371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.765518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.765595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.765749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.765824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.765976 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.766060 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.766208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.766284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.766434 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.766508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.766665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.766749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.766896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.766972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.767129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.767204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.767360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.767446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.767604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.767680 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.767856 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.767932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.768094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.768180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.768322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] auth.external = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.768496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.768570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.768638 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] auth.external = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.768819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.768909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.769082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.769158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.769313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] auth.password = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.769389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.769542 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] auth.token = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.769620 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] auth.password = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.769773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] auth.token = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.769855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.770004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.770081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.770225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.770298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.770463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.770539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.770693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.770770 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.770943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.771021 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.771171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.771246 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.771406 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] credential.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.771482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.771639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] credential.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.771725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.771882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.771959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.772127 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.772203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.772373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.772452 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.772621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.772701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.772855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.772932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.773123 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.773199 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.773373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.773476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.773614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.773736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.773864 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.773978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.774144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.774222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.774387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.774507 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.774650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.774751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.774889 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.775028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.775141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.775273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.775375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] federation.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.775532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.775620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.775770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] federation.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.775848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.776016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.776094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.776279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.776384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.776555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.776633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.776788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.776864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.777036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.777126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.777267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.777343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.777516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.777594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.777752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.777837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.777994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.778071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.778228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.778305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.778473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.778559 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.778710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.778793 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.778941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.779017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.779176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.779263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.779422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.779500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.779650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.779727 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.779885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.779973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.780117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.780193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.780400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.780483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.780607 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.780686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.780837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.780920 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.781065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.781143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.781312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.781391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.781557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.781654 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.781787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.781869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.782031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.782110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.782282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.782360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.782538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.782616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.782772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.782850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.783006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.783084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.783237 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.783314 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.783477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.783563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.783706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.783784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.783940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.784020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.784170 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.784249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.784430 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.784510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.784675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.784751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.784903 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.784981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.785146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.785223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.785389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.785466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.785621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.785699 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.785871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.785947 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.786112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.786189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.786352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.786428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.786595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.786674 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.786828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.786905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.787067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.787145 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.787295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.787373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.787534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.787610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.787772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.787860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.788003 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.788080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.788238 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.788314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.788500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.788581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.788756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.788832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.788989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.789067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.789237 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.789322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.789485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.789568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.789719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.789798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.789955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.790034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.790190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.790267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.790419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.790496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.790684 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.790774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.790888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.790966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.791124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.791200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.791368 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.791447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.791609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.791686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.791850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.791926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.792145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.792238 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.792311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.792401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.792559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.792651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.792793 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.792873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.793028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.793105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.793254 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.793338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.793490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.793568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.793724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.793802 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.793964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.794323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.794482 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.794560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.794725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.794801 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.794951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.795039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.795192 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.795271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.795421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.795498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.795651 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.795735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.795882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.795960 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.796114 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.796192 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.796347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.796493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.796604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.796682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.796837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.796913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.797084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.797169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.797309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.797386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.797548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.797626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.797781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.797866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.798014 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.798093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.798247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.798325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.798481 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.798566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.798717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.798794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.798961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.799038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.799196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.799282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.799428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.799505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] resource.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.799666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.799744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.799907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] resource.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.799992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.800139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.800216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.800409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.800490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.800647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.800736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.800879 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.800956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.801123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.801201 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.801354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.801444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.801587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.801664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.801819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] role.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.801896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.802054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.802140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] role.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.802278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.802355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] role.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.802524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.802601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] role.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.802793 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.802993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.802993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.803133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.803230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.803417 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.803492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.803570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.803708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.803794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.803949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.804026 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.804194 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.804824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.804964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.805041 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.805213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.805290 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.805450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.805531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.805692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.805769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.805946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.806026 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.806184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.806334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.806432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.806569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.806817 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.806894 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.807063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.807140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.807305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.807381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.807553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.807630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.807782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.807860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.808033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.808110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.808265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.808341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.808532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.808615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.808763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.808841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.808993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.809071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.809224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.809303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.809455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.809537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.809690 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.809768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.809941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.810020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.810176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.810254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.810447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.810649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.810739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.810884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.810963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.811114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.811190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] token.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.811345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.811430 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] token.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.811585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.811663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.811819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.811895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.812063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.812142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.812306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.812411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.812574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.812652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.812813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.812893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.813055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.813131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.813296 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.813373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.813529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.813607 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.813766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.813844 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.814004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.814080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.814241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.814321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.814485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.814562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.814714 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.814792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.814956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.815034 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.815202 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.815280 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.815456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.connection = **** {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.815532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.815697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.815775 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.connection = **** {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.815942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.816020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.816178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.816255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.816437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.816518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.816672 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.816749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.816909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.816986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.817143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.817222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.817377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.817454 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.817611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.817688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.817858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.817937 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.818104 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.818189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.818339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.818418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.818584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.818670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.818814 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.818900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.819057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.819134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.819306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.819417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.819540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.819709 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.819791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.820037 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.820683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:23:50.820812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:23:50.820890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:23:50.850530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.850760 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.850989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.851264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.851499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.851725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.859561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.860164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.888932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.889165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.889267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.889465 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.942792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.943600 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.995715 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:50.995957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.061246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.061482 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.065605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.065840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.066069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.066291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.066511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.066728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.107192 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.107400 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.107620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.107840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.108061 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.108281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.131934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.132142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.132380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.132655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.132877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.133092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.133307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.145666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.158957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.159182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.159409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.159634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.159860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.160077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.160292 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73667) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.166383 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.166616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.166845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.167067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.167283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.167499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.167712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.176011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.178932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.179120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.179891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 04:23:51.180047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.180182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.180321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.180469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 04:23:51.180594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.180718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.180843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.180843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.181173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.181305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73668) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:23:51.181429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.181429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.191456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.191731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 04:23:51.191914 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.192052 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.192203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.192336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 04:23:51.192517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.192724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.192893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.193035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.193252 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.193513 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.201130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.204316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.204471 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.204625 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.204708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.204908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.204994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.205191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.205273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.205481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.205741 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.206012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.206286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.206556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.206827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.207095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.213455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.216728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.217012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.217295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.217589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.217873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.218135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.218420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.218690 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.219006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.219280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.219561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.234029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.235608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.235890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.241174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.241452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.241729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.246873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.248512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.248775 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.249422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.249707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.254084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.254180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.254366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.254450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.254646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.254772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.254929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.255208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.255483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.255753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.256020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.262147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.262434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.266959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.267248 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.267542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.267825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.268101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.268395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.268682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.268968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.274670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.274941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.279439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.283155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.283445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.287407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.287684 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.288416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.292633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.292767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.296475 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.296665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.296776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.296963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.297046 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.297325 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.297603 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.297896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.302003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.306305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.309917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.310220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.310511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.310803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.311093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.311402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.317470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.317779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.318135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.318316 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.326148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.327950 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.328272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.330527 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.330835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.331106 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.331319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.331449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.331594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.331867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.332148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.332449 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.339203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.340959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.341240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.344459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.344751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.345044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.345338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.345619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.346066 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.346353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.346635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.346915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.347200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.347474 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.347764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.359751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.360038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.360321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.360631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.362455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.362747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.363034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.366235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.370181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.375048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.376670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.378369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.378676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.379679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.381547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.384986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.386228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.387801 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.388223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.389998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.391136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.391420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.391616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.391760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.391895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.392040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.392170 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.399472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.401077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.401222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.401352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.401640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.404258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.404574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.404975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.405260 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.409520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73667) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.409800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.410081 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.410354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.410632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.410900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.411176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.411451 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.411712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.411988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.412264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.412552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.412832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.413090 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73667) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.414841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.415142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.415426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.423484 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73668) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:23:51.423764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.424051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.424340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.424643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.425019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.425295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.425567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.425838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.426128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.426409 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.426675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.426947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.427219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73668) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:23:51.451901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f873909c0 pid: 73667 (default app) Aug 27 04:23:51.455218 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf9c3a-95b7-40f9-9f6e-e3cd74b2f6b1 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:51.455510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf9c3a-95b7-40f9-9f6e-e3cd74b2f6b1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:51.455789 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf9c3a-95b7-40f9-9f6e-e3cd74b2f6b1 None None] PATH_INFO: `/v3` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:51.460074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 792 bytes} [Fri Aug 27 04:23:51 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:23:51.465537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f873909c0 pid: 73668 (default app) Aug 27 04:24:00.105648 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3309-28da-45f3-9c18-6f2153ddcdb8 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:00.106136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3309-28da-45f3-9c18-6f2153ddcdb8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:00.106136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3309-28da-45f3-9c18-6f2153ddcdb8 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:00.108301 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:24:00.116619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaeeb1-be2f-49d2-9fb1-2307bf00f94c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:00.117014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaeeb1-be2f-49d2-9fb1-2307bf00f94c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:00.117193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaeeb1-be2f-49d2-9fb1-2307bf00f94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:00.147660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG oslo_db.sqlalchemy.engines [None req-e1aaeeb1-be2f-49d2-9fb1-2307bf00f94c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:24:00.333990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG passlib.handlers.bcrypt [None req-e1aaeeb1-be2f-49d2-9fb1-2307bf00f94c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73668) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 04:24:00.334422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG passlib.handlers.bcrypt [None req-e1aaeeb1-be2f-49d2-9fb1-2307bf00f94c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73668) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 04:24:00.389338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e1aaeeb1-be2f-49d2-9fb1-2307bf00f94c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:00.390924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e1aaeeb1-be2f-49d2-9fb1-2307bf00f94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:00.535373 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:00.681751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db3309-28da-45f3-9c18-6f2153ddcdb8 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:00.716564 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG oslo_db.sqlalchemy.engines [None req-d3db3309-28da-45f3-9c18-6f2153ddcdb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:24:00.847853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db3309-28da-45f3-9c18-6f2153ddcdb8 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:00.852148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6adbc-c95a-4c43-b2ab-13f7ea17ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:00.852872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6adbc-c95a-4c43-b2ab-13f7ea17ab53 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:00.853157 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6adbc-c95a-4c43-b2ab-13f7ea17ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:00.853435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6adbc-c95a-4c43-b2ab-13f7ea17ab53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:00.861449 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6adbc-c95a-4c43-b2ab-13f7ea17ab53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:00.912594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.common.rbac_enforcer.enforcer [None req-00a6adbc-c95a-4c43-b2ab-13f7ea17ab53 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 04:24:00.912938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6adbc-c95a-4c43-b2ab-13f7ea17ab53 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:00.922659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:24:00.929319 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaeeb1-be2f-49d2-9fb1-2307bf00f94c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:00.943280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaeeb1-be2f-49d2-9fb1-2307bf00f94c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:00.948645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27680e8a-52fb-48ff-bee6-3314b73fe43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:00.949710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680e8a-52fb-48ff-bee6-3314b73fe43a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:00.949996 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680e8a-52fb-48ff-bee6-3314b73fe43a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:00.950273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680e8a-52fb-48ff-bee6-3314b73fe43a admin admin] PATH_INFO: `/v3/projects/28c22cecb66d4652809a04ec1798ad5b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:00.952202 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27680e8a-52fb-48ff-bee6-3314b73fe43a admin admin] RBAC: Authorizing `identity:get_project(project_id=28c22cecb66d4652809a04ec1798ad5b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:01.010444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.common.rbac_enforcer.enforcer [None req-27680e8a-52fb-48ff-bee6-3314b73fe43a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 04:24:01.010782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27680e8a-52fb-48ff-bee6-3314b73fe43a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:01.015472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 2/5] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:00 2021] GET /identity/v3/projects/28c22cecb66d4652809a04ec1798ad5b => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:03.114571 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a394d11-1682-4712-965d-58ec64ff9f55 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:03.115093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a394d11-1682-4712-965d-58ec64ff9f55 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:03.115093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a394d11-1682-4712-965d-58ec64ff9f55 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:03.120222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 4/6] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:03 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:03.126740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1997-bd40-45f9-a725-1df751842995 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:03.127147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1997-bd40-45f9-a725-1df751842995 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:03.127297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1997-bd40-45f9-a725-1df751842995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:03.145658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d16c1997-bd40-45f9-a725-1df751842995 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:03.147168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d16c1997-bd40-45f9-a725-1df751842995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:03.154883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:03.178649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a394d11-1682-4712-965d-58ec64ff9f55 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:03.191442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a394d11-1682-4712-965d-58ec64ff9f55 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:03.195675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbccee-5c22-4d33-a839-026624058ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:03.196306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbccee-5c22-4d33-a839-026624058ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:03.196621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbccee-5c22-4d33-a839-026624058ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:03.196902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbccee-5c22-4d33-a839-026624058ed5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:03.204861 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbccee-5c22-4d33-a839-026624058ed5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:03.206646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbccee-5c22-4d33-a839-026624058ed5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:03.215245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:03.221302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c1997-bd40-45f9-a725-1df751842995 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:03.230784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c1997-bd40-45f9-a725-1df751842995 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:03.235132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff31eb5-4f23-48c1-b38d-a735c231961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:03.235981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff31eb5-4f23-48c1-b38d-a735c231961d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:03.236262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff31eb5-4f23-48c1-b38d-a735c231961d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:03.236570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff31eb5-4f23-48c1-b38d-a735c231961d admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:03.237939 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff31eb5-4f23-48c1-b38d-a735c231961d admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:03.239769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff31eb5-4f23-48c1-b38d-a735c231961d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:03.241355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 4/9] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:03 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:05.434160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ee7d9-9fb9-45f9-ab13-36d63dbd4f1a None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.434705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ee7d9-9fb9-45f9-ab13-36d63dbd4f1a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.434705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ee7d9-9fb9-45f9-ab13-36d63dbd4f1a None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.436480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:05.439684 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864f4eb-5dca-459b-948b-c22a47cc6511 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.440080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864f4eb-5dca-459b-948b-c22a47cc6511 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.440385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864f4eb-5dca-459b-948b-c22a47cc6511 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.442004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56b14-b5bf-4d21-ba66-05465f8c4a65 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.442291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56b14-b5bf-4d21-ba66-05465f8c4a65 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.442576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56b14-b5bf-4d21-ba66-05465f8c4a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.442684 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 5/11] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:05.448209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b8f7b-bf95-4868-b10c-b47b59a59719 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.448531 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b8f7b-bf95-4868-b10c-b47b59a59719 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.448810 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b8f7b-bf95-4868-b10c-b47b59a59719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.465723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-202b8f7b-bf95-4868-b10c-b47b59a59719 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:05.466907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-202b8f7b-bf95-4868-b10c-b47b59a59719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:05.474501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:05.483992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG passlib.handlers.bcrypt [None req-a8b56b14-b5bf-4d21-ba66-05465f8c4a65 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73667) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 04:24:05.484441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG passlib.handlers.bcrypt [None req-a8b56b14-b5bf-4d21-ba66-05465f8c4a65 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73667) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 04:24:05.497852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b8f7b-bf95-4868-b10c-b47b59a59719 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:05.506517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b8f7b-bf95-4868-b10c-b47b59a59719 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:05.511002 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61011caa-2f4b-4858-8293-768f9a229093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:05.511629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61011caa-2f4b-4858-8293-768f9a229093 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.511910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61011caa-2f4b-4858-8293-768f9a229093 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.512180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61011caa-2f4b-4858-8293-768f9a229093 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.519629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61011caa-2f4b-4858-8293-768f9a229093 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:05.521424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61011caa-2f4b-4858-8293-768f9a229093 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:05.529864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:24:05.531036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a8b56b14-b5bf-4d21-ba66-05465f8c4a65 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:05.532693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a8b56b14-b5bf-4d21-ba66-05465f8c4a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:05.535586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61011caa-2f4b-4858-8293-768f9a229093 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:05.544600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61011caa-2f4b-4858-8293-768f9a229093 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:05.548907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f505899-d2af-4ea5-9ba5-2eb0bd4eb4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:05.549644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f505899-d2af-4ea5-9ba5-2eb0bd4eb4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.549922 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f505899-d2af-4ea5-9ba5-2eb0bd4eb4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.550194 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f505899-d2af-4ea5-9ba5-2eb0bd4eb4a2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.551329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f505899-d2af-4ea5-9ba5-2eb0bd4eb4a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:05.553030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f505899-d2af-4ea5-9ba5-2eb0bd4eb4a2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:05.554529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 8/14] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:05.571634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 7/15] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:05.596012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f505899-d2af-4ea5-9ba5-2eb0bd4eb4a2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:05.607021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f505899-d2af-4ea5-9ba5-2eb0bd4eb4a2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:05.612013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efc6e3-ff25-4bee-af1c-dcf8381946d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:05.612841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efc6e3-ff25-4bee-af1c-dcf8381946d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.613130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efc6e3-ff25-4bee-af1c-dcf8381946d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.613407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efc6e3-ff25-4bee-af1c-dcf8381946d9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.629382 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efc6e3-ff25-4bee-af1c-dcf8381946d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:05.636497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-f9efc6e3-ff25-4bee-af1c-dcf8381946d9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:05.637785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 9/16] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:05.644640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b56b14-b5bf-4d21-ba66-05465f8c4a65 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:05.654188 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b56b14-b5bf-4d21-ba66-05465f8c4a65 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:05.658803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86120a-991f-4732-9d4c-4edcd69a53dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:05.659803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86120a-991f-4732-9d4c-4edcd69a53dc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.660091 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86120a-991f-4732-9d4c-4edcd69a53dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.660393 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86120a-991f-4732-9d4c-4edcd69a53dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.661332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86120a-991f-4732-9d4c-4edcd69a53dc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:05.661646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86120a-991f-4732-9d4c-4edcd69a53dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:05.663464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-3d86120a-991f-4732-9d4c-4edcd69a53dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:05.663464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:05.663464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:05.664500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86120a-991f-4732-9d4c-4edcd69a53dc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:05.682922 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 8/17] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:05.689961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efc6e3-ff25-4bee-af1c-dcf8381946d9 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:05.702837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efc6e3-ff25-4bee-af1c-dcf8381946d9 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:05.707681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88a108-a979-4bdb-81da-9356db8993b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:05.708691 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88a108-a979-4bdb-81da-9356db8993b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.709048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88a108-a979-4bdb-81da-9356db8993b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.709395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88a108-a979-4bdb-81da-9356db8993b6 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.710753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88a108-a979-4bdb-81da-9356db8993b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:05.713315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88a108-a979-4bdb-81da-9356db8993b6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:05.714925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:05 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:05.721723 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86120a-991f-4732-9d4c-4edcd69a53dc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:05.732511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86120a-991f-4732-9d4c-4edcd69a53dc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:05.737200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f7af-538a-4d7c-9d9e-19bf1a173f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:05.738002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f7af-538a-4d7c-9d9e-19bf1a173f06 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.738278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f7af-538a-4d7c-9d9e-19bf1a173f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.738724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f7af-538a-4d7c-9d9e-19bf1a173f06 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.740250 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324f7af-538a-4d7c-9d9e-19bf1a173f06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:05.742062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324f7af-538a-4d7c-9d9e-19bf1a173f06 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:05.743669 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:05.750403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88a108-a979-4bdb-81da-9356db8993b6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:05.760081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88a108-a979-4bdb-81da-9356db8993b6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:05.764550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b297e35-b287-4795-b96b-50cad174f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:05.765191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297e35-b287-4795-b96b-50cad174f330 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:05.765473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297e35-b287-4795-b96b-50cad174f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:05.765748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297e35-b287-4795-b96b-50cad174f330 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:05.766576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b297e35-b287-4795-b96b-50cad174f330 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.domain.id=default, user.id=a3eedbef815445d78eda15afd8ed2501) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:05.766884 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b297e35-b287-4795-b96b-50cad174f330 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:05.768641 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-7b297e35-b287-4795-b96b-50cad174f330 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:05.768641 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:05.768641 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:05.769819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b297e35-b287-4795-b96b-50cad174f330 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:05.777374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1344 bytes} [Fri Aug 27 04:24:05 2021] GET /identity/v3/role_assignments?user.id=a3eedbef815445d78eda15afd8ed2501&scope.domain.id=default&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 233 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:08.425271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209678a6-2b98-4716-8ae3-ccd26f789515 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.426273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209678a6-2b98-4716-8ae3-ccd26f789515 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.426784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209678a6-2b98-4716-8ae3-ccd26f789515 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.429092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:08.435438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcfe7b-d108-46b5-a7c4-e8c0c48bd029 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.435882 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcfe7b-d108-46b5-a7c4-e8c0c48bd029 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.436071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcfe7b-d108-46b5-a7c4-e8c0c48bd029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.456610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4b89-ce9a-48f6-a946-9ceef60423c3 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.457287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4b89-ce9a-48f6-a946-9ceef60423c3 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.457792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4b89-ce9a-48f6-a946-9ceef60423c3 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.460021 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:24:08.465642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a4439-a96b-4bac-b597-bee517175a0c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.466211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a4439-a96b-4bac-b597-bee517175a0c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.466807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a4439-a96b-4bac-b597-bee517175a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.467374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-4afcfe7b-d108-46b5-a7c4-e8c0c48bd029 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:08.468584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4afcfe7b-d108-46b5-a7c4-e8c0c48bd029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:08.482368 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:08.483682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746a157-3d13-4d0a-b0b8-085b05d537b7 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.483968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746a157-3d13-4d0a-b0b8-085b05d537b7 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.484240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746a157-3d13-4d0a-b0b8-085b05d537b7 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.489354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:08 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:08.499795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-6d2a4439-a96b-4bac-b597-bee517175a0c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:08.505089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6d2a4439-a96b-4bac-b597-bee517175a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:08.517291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:08.538789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec82016-1983-4f43-bc1d-205832c87d1a None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.539085 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec82016-1983-4f43-bc1d-205832c87d1a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.539345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec82016-1983-4f43-bc1d-205832c87d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.548923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a4439-a96b-4bac-b597-bee517175a0c None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:08.563521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a4439-a96b-4bac-b597-bee517175a0c None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:08.568135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e9ddf-6a0f-4654-9ec3-9219ca2ab450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:08.568980 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e9ddf-6a0f-4654-9ec3-9219ca2ab450 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.569268 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e9ddf-6a0f-4654-9ec3-9219ca2ab450 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.569436 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-1ec82016-1983-4f43-bc1d-205832c87d1a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:08.569566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e9ddf-6a0f-4654-9ec3-9219ca2ab450 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.570654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1ec82016-1983-4f43-bc1d-205832c87d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:08.591580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 14/26] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:08.591756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e9ddf-6a0f-4654-9ec3-9219ca2ab450 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:08.592431 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec82016-1983-4f43-bc1d-205832c87d1a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:08.602030 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e9ddf-6a0f-4654-9ec3-9219ca2ab450 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:08.610585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec82016-1983-4f43-bc1d-205832c87d1a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:08.623195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-b52e9ddf-6a0f-4654-9ec3-9219ca2ab450 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:08.624938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 13/27] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:08.632100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e9ddf-6a0f-4654-9ec3-9219ca2ab450 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:08.632323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a9106-5e9a-4525-9d6d-c1b2195508a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:08.632874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a9106-5e9a-4525-9d6d-c1b2195508a4 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.633160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a9106-5e9a-4525-9d6d-c1b2195508a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.633431 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a9106-5e9a-4525-9d6d-c1b2195508a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.634234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a9106-5e9a-4525-9d6d-c1b2195508a4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:08.635273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-3d3a9106-5e9a-4525-9d6d-c1b2195508a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:08.635273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:08.635273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:08.636209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a9106-5e9a-4525-9d6d-c1b2195508a4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:08.643335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e9ddf-6a0f-4654-9ec3-9219ca2ab450 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:08.648040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716f2ca-13cd-469a-860d-f55f3a59599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:08.648751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716f2ca-13cd-469a-860d-f55f3a59599c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.649043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716f2ca-13cd-469a-860d-f55f3a59599c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.649342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716f2ca-13cd-469a-860d-f55f3a59599c admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.650123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716f2ca-13cd-469a-860d-f55f3a59599c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:08.650433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716f2ca-13cd-469a-860d-f55f3a59599c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:08.651642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-5716f2ca-13cd-469a-860d-f55f3a59599c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:08.651642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:08.651642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:08.652643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716f2ca-13cd-469a-860d-f55f3a59599c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:08.676615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 14/28] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:08.677491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716f2ca-13cd-469a-860d-f55f3a59599c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:08.689590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716f2ca-13cd-469a-860d-f55f3a59599c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:08.694576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868261b7-e2ae-4bb5-990b-10ec3a911bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:08.695962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868261b7-e2ae-4bb5-990b-10ec3a911bfb admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.695962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868261b7-e2ae-4bb5-990b-10ec3a911bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.695962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868261b7-e2ae-4bb5-990b-10ec3a911bfb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.711097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868261b7-e2ae-4bb5-990b-10ec3a911bfb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:08.719190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-868261b7-e2ae-4bb5-990b-10ec3a911bfb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:08.720483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 15/29] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:08.721267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868261b7-e2ae-4bb5-990b-10ec3a911bfb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:08.732078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868261b7-e2ae-4bb5-990b-10ec3a911bfb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:08.736719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ab99a-36c4-407b-8d66-871808bfdccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:08.737398 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab99a-36c4-407b-8d66-871808bfdccb admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.737685 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab99a-36c4-407b-8d66-871808bfdccb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.737963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab99a-36c4-407b-8d66-871808bfdccb admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.738684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ab99a-36c4-407b-8d66-871808bfdccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:08.739741 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-639ab99a-36c4-407b-8d66-871808bfdccb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:08.739741 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:08.739741 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:08.741124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ab99a-36c4-407b-8d66-871808bfdccb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:08.955169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 15/30] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:24:08 2021] POST /identity/v3/roles => generated 219 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:08.956838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95195983-f4d0-4cd2-b3b2-0874de691fc9 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.957137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95195983-f4d0-4cd2-b3b2-0874de691fc9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.957414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95195983-f4d0-4cd2-b3b2-0874de691fc9 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.964641 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 16/31] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:08.965613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95195983-f4d0-4cd2-b3b2-0874de691fc9 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:08.980058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95195983-f4d0-4cd2-b3b2-0874de691fc9 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:08.984552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30586446-847c-4c82-8ccb-58a562db4812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:08.985415 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30586446-847c-4c82-8ccb-58a562db4812 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:08.985701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30586446-847c-4c82-8ccb-58a562db4812 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:08.985984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30586446-847c-4c82-8ccb-58a562db4812 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:08.986758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30586446-847c-4c82-8ccb-58a562db4812 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:08.987067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30586446-847c-4c82-8ccb-58a562db4812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:08.988277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-30586446-847c-4c82-8ccb-58a562db4812 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:08.988277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:08.988277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:08.989213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30586446-847c-4c82-8ccb-58a562db4812 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:09.008719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 17/32] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:09.010137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b20b5d-557b-4481-83f9-0bf901dab785 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.010436 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b20b5d-557b-4481-83f9-0bf901dab785 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.010721 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b20b5d-557b-4481-83f9-0bf901dab785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.032193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b1b20b5d-557b-4481-83f9-0bf901dab785 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:09.033770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b1b20b5d-557b-4481-83f9-0bf901dab785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:09.043461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 18/33] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:09.044710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b20b5d-557b-4481-83f9-0bf901dab785 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:09.065089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 16/34] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:24:08 2021] POST /identity/v3/projects => generated 301 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:09.070677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b20b5d-557b-4481-83f9-0bf901dab785 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:09.073814 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ab99a-36c4-407b-8d66-871808bfdccb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:09.137891 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4d74c-fdd8-4c42-9f24-406a019a7242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:09.138916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4d74c-fdd8-4c42-9f24-406a019a7242 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.139203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4d74c-fdd8-4c42-9f24-406a019a7242 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.139484 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4d74c-fdd8-4c42-9f24-406a019a7242 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.140794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4d74c-fdd8-4c42-9f24-406a019a7242 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:09.142827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4d74c-fdd8-4c42-9f24-406a019a7242 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:09.144946 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 19/35] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:09 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:09.151719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4d74c-fdd8-4c42-9f24-406a019a7242 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:09.162063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4d74c-fdd8-4c42-9f24-406a019a7242 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:09.167377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b530ea-5d48-4096-8ee0-6b277ca52219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:09.168187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b530ea-5d48-4096-8ee0-6b277ca52219 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.168573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b530ea-5d48-4096-8ee0-6b277ca52219 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.169116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b530ea-5d48-4096-8ee0-6b277ca52219 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.170554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b530ea-5d48-4096-8ee0-6b277ca52219 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:09.172611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b530ea-5d48-4096-8ee0-6b277ca52219 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:09.174799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 20/36] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:09.181928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b530ea-5d48-4096-8ee0-6b277ca52219 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:09.193156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b530ea-5d48-4096-8ee0-6b277ca52219 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:09.206126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290e675-556d-4fe7-876b-ba74ea20887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:09.207743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290e675-556d-4fe7-876b-ba74ea20887b admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.208052 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290e675-556d-4fe7-876b-ba74ea20887b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.208692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290e675-556d-4fe7-876b-ba74ea20887b admin admin] PATH_INFO: `/v3/domains/default/users/a3eedbef815445d78eda15afd8ed2501/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.212083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ab99a-36c4-407b-8d66-871808bfdccb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:09.213560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290e675-556d-4fe7-876b-ba74ea20887b admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a3eedbef815445d78eda15afd8ed2501, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:09.214665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-7290e675-556d-4fe7-876b-ba74ea20887b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:09.214665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:09.214665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:09.218654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290e675-556d-4fe7-876b-ba74ea20887b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:09.225059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48581368-00c0-4940-b488-75ad684095c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:09.225923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581368-00c0-4940-b488-75ad684095c6 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.226219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581368-00c0-4940-b488-75ad684095c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.226495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581368-00c0-4940-b488-75ad684095c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.230094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48581368-00c0-4940-b488-75ad684095c6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:09.233864 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-48581368-00c0-4940-b488-75ad684095c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:09.233864 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:09.233864 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:09.235243 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48581368-00c0-4940-b488-75ad684095c6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:09.346932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 21/37] 10.222.0.25 () {58 vars in 1383 bytes} [Fri Aug 27 04:24:09 2021] PUT /identity/v3/domains/default/users/a3eedbef815445d78eda15afd8ed2501/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:24:09.346932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedd98-39e4-4423-b63e-71ef1d05b1bf None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.346932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedd98-39e4-4423-b63e-71ef1d05b1bf None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.346932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedd98-39e4-4423-b63e-71ef1d05b1bf None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.346932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 22/38] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:09.354787 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68169c60-9755-4805-ba58-33172548513c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.355264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68169c60-9755-4805-ba58-33172548513c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.355548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68169c60-9755-4805-ba58-33172548513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.377328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-68169c60-9755-4805-ba58-33172548513c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:09.378572 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-68169c60-9755-4805-ba58-33172548513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:09.387278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 17/39] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:24:09 2021] POST /identity/v3/roles => generated 225 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:24:09.459043 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 23/40] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:09.486088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48581368-00c0-4940-b488-75ad684095c6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:09.502574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48581368-00c0-4940-b488-75ad684095c6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:09.509277 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32369d5b-74e1-49a9-b8aa-c04ff83b9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:09.510355 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369d5b-74e1-49a9-b8aa-c04ff83b9cac admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.510834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369d5b-74e1-49a9-b8aa-c04ff83b9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.511347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369d5b-74e1-49a9-b8aa-c04ff83b9cac admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.512293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32369d5b-74e1-49a9-b8aa-c04ff83b9cac admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:09.514221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32369d5b-74e1-49a9-b8aa-c04ff83b9cac admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:09.595904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 18/41] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:24:09 2021] POST /identity/v3/roles => generated 223 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:09.893129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dc196-60b3-4061-8088-921c96345f5f None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.893458 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dc196-60b3-4061-8088-921c96345f5f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.893733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dc196-60b3-4061-8088-921c96345f5f None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.895584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 24/42] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:09.902613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844327c-8c38-418a-8be4-a95185d93729 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.903001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844327c-8c38-418a-8be4-a95185d93729 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.903291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844327c-8c38-418a-8be4-a95185d93729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.921882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-3844327c-8c38-418a-8be4-a95185d93729 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:09.923404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-3844327c-8c38-418a-8be4-a95185d93729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:09.931377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 19/43] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:09.955915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dc196-60b3-4061-8088-921c96345f5f None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:09.969219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dc196-60b3-4061-8088-921c96345f5f None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:09.973523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ded70-191f-4a4b-86ac-68895f50d408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:09.974309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ded70-191f-4a4b-86ac-68895f50d408 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:09.974598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ded70-191f-4a4b-86ac-68895f50d408 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:09.974880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ded70-191f-4a4b-86ac-68895f50d408 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:09.976045 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ded70-191f-4a4b-86ac-68895f50d408 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:09.977850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ded70-191f-4a4b-86ac-68895f50d408 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:09.979447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 25/44] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:09.985703 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844327c-8c38-418a-8be4-a95185d93729 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:09.995174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844327c-8c38-418a-8be4-a95185d93729 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:09.999973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5ae38-6b0c-40c1-a062-589b1ebb2ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:10.000680 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5ae38-6b0c-40c1-a062-589b1ebb2ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:10.001006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5ae38-6b0c-40c1-a062-589b1ebb2ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:10.001246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5ae38-6b0c-40c1-a062-589b1ebb2ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:10.002049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5ae38-6b0c-40c1-a062-589b1ebb2ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:10.004083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5ae38-6b0c-40c1-a062-589b1ebb2ce2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:10.115488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 20/45] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:24:09 2021] POST /identity/v3/projects => generated 312 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:11.530913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421b41a-d896-4647-ad16-ea15b2cef3f8 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:11.531470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421b41a-d896-4647-ad16-ea15b2cef3f8 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:11.531470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421b41a-d896-4647-ad16-ea15b2cef3f8 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:11.533269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 26/46] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:11.539163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95812cc-a00f-4c91-a217-e85c0ad5946d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:11.539572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95812cc-a00f-4c91-a217-e85c0ad5946d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:11.539715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95812cc-a00f-4c91-a217-e85c0ad5946d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:11.557229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e95812cc-a00f-4c91-a217-e85c0ad5946d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:11.558422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e95812cc-a00f-4c91-a217-e85c0ad5946d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:11.613502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 21/47] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:11.637668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421b41a-d896-4647-ad16-ea15b2cef3f8 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:11.650163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421b41a-d896-4647-ad16-ea15b2cef3f8 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:11.654514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85c8be-530a-4990-946e-6fc6d4167fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:11.655418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85c8be-530a-4990-946e-6fc6d4167fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:11.655720 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85c8be-530a-4990-946e-6fc6d4167fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:11.656045 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85c8be-530a-4990-946e-6fc6d4167fb1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:11.666644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85c8be-530a-4990-946e-6fc6d4167fb1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:11.673734 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-2c85c8be-530a-4990-946e-6fc6d4167fb1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:11.674940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 27/48] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:11.681860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95812cc-a00f-4c91-a217-e85c0ad5946d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:11.690921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95812cc-a00f-4c91-a217-e85c0ad5946d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:11.695457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0c99b-3dbc-423a-9f55-7a3561510781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:11.696129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0c99b-3dbc-423a-9f55-7a3561510781 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:11.697004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0c99b-3dbc-423a-9f55-7a3561510781 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:11.697285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0c99b-3dbc-423a-9f55-7a3561510781 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:11.698052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0c99b-3dbc-423a-9f55-7a3561510781 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:11.698356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0c99b-3dbc-423a-9f55-7a3561510781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:11.700003 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0c99b-3dbc-423a-9f55-7a3561510781 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:11.708627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 22/49] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:11.714792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85c8be-530a-4990-946e-6fc6d4167fb1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:11.725031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85c8be-530a-4990-946e-6fc6d4167fb1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:11.729423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d549f-849d-4fba-9c44-4cb3012e0005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:11.730266 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d549f-849d-4fba-9c44-4cb3012e0005 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:11.730551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d549f-849d-4fba-9c44-4cb3012e0005 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:11.730828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d549f-849d-4fba-9c44-4cb3012e0005 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:11.732027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d549f-849d-4fba-9c44-4cb3012e0005 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:11.733902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d549f-849d-4fba-9c44-4cb3012e0005 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:11.735479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 28/50] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:11 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:11.742411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0c99b-3dbc-423a-9f55-7a3561510781 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:11.754930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0c99b-3dbc-423a-9f55-7a3561510781 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:11.759894 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8eb9cd-cb15-482a-bf99-8f45ae1a636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:11.760704 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eb9cd-cb15-482a-bf99-8f45ae1a636f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:11.761015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eb9cd-cb15-482a-bf99-8f45ae1a636f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:11.761278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eb9cd-cb15-482a-bf99-8f45ae1a636f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:11.762451 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8eb9cd-cb15-482a-bf99-8f45ae1a636f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:11.764150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8eb9cd-cb15-482a-bf99-8f45ae1a636f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:11.765767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 23/51] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:11.772212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d549f-849d-4fba-9c44-4cb3012e0005 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:11.782256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d549f-849d-4fba-9c44-4cb3012e0005 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:11.786579 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc271e7a-319b-4b03-9c2b-f487a35ca6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:11.787221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271e7a-319b-4b03-9c2b-f487a35ca6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:11.787519 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271e7a-319b-4b03-9c2b-f487a35ca6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:11.787793 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271e7a-319b-4b03-9c2b-f487a35ca6e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:11.788668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc271e7a-319b-4b03-9c2b-f487a35ca6e1 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.domain.id=default, user.id=a3eedbef815445d78eda15afd8ed2501) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:11.788984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc271e7a-319b-4b03-9c2b-f487a35ca6e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:11.790864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc271e7a-319b-4b03-9c2b-f487a35ca6e1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:11.796876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 29/52] 10.222.0.25 () {56 vars in 1344 bytes} [Fri Aug 27 04:24:11 2021] GET /identity/v3/role_assignments?user.id=a3eedbef815445d78eda15afd8ed2501&scope.domain.id=default&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:12.280224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b008b1f-52dd-4c75-8165-b977b9407401 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:12.280536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b008b1f-52dd-4c75-8165-b977b9407401 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:12.280823 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b008b1f-52dd-4c75-8165-b977b9407401 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:12.282622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 24/53] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:12.289006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acedc67-9758-43d0-928a-184e5b0a5fd9 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:12.289303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acedc67-9758-43d0-928a-184e5b0a5fd9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:12.289585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acedc67-9758-43d0-928a-184e5b0a5fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:12.308434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-9acedc67-9758-43d0-928a-184e5b0a5fd9 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:12.309642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9acedc67-9758-43d0-928a-184e5b0a5fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:12.317279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 30/54] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:12.341701 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b008b1f-52dd-4c75-8165-b977b9407401 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:12.354314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b008b1f-52dd-4c75-8165-b977b9407401 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:12.358563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12527f13-c197-45b2-8a6c-506b62cb85a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:12.359342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12527f13-c197-45b2-8a6c-506b62cb85a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:12.359631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12527f13-c197-45b2-8a6c-506b62cb85a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:12.359911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12527f13-c197-45b2-8a6c-506b62cb85a0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:12.361131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12527f13-c197-45b2-8a6c-506b62cb85a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:12.362840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12527f13-c197-45b2-8a6c-506b62cb85a0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:12.364442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 25/55] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:12.370961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acedc67-9758-43d0-928a-184e5b0a5fd9 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:12.379809 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acedc67-9758-43d0-928a-184e5b0a5fd9 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:12.384173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92ff52-cd79-4ad9-b994-d8582d4ff495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:12.384907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92ff52-cd79-4ad9-b994-d8582d4ff495 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:12.385193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92ff52-cd79-4ad9-b994-d8582d4ff495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:12.385471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92ff52-cd79-4ad9-b994-d8582d4ff495 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:12.386165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92ff52-cd79-4ad9-b994-d8582d4ff495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:12.387270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-bc92ff52-cd79-4ad9-b994-d8582d4ff495 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:12.387270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:12.387270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:12.388777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92ff52-cd79-4ad9-b994-d8582d4ff495 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:12.484070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 31/56] 10.222.0.25 () {60 vars in 1162 bytes} [Fri Aug 27 04:24:12 2021] POST /identity/v3/projects => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:14.637482 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee2263-7b04-423f-8fea-d4eee2a94001 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:14.638071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee2263-7b04-423f-8fea-d4eee2a94001 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:14.638071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee2263-7b04-423f-8fea-d4eee2a94001 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:14.639802 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 26/57] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:14.645898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd86fd-4faf-4869-836a-f8744d041ff8 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:14.646377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd86fd-4faf-4869-836a-f8744d041ff8 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:14.646462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd86fd-4faf-4869-836a-f8744d041ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:14.674074 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d2cd86fd-4faf-4869-836a-f8744d041ff8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:14.675292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d2cd86fd-4faf-4869-836a-f8744d041ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:14.734508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 32/58] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:14.761344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee2263-7b04-423f-8fea-d4eee2a94001 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:14.773569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee2263-7b04-423f-8fea-d4eee2a94001 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:14.777978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ba79-e735-497f-8d93-217b453bff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:14.778764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ba79-e735-497f-8d93-217b453bff24 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:14.779051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ba79-e735-497f-8d93-217b453bff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:14.779333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ba79-e735-497f-8d93-217b453bff24 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:14.780567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09ba79-e735-497f-8d93-217b453bff24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:14.782317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09ba79-e735-497f-8d93-217b453bff24 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:14.783900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 27/59] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:14.790140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd86fd-4faf-4869-836a-f8744d041ff8 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:14.800321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd86fd-4faf-4869-836a-f8744d041ff8 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:14.804910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b8197-bb60-4ba4-b545-710c8e27ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:14.806056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8197-bb60-4ba4-b545-710c8e27ff6d admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:14.806341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8197-bb60-4ba4-b545-710c8e27ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:14.806617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8197-bb60-4ba4-b545-710c8e27ff6d admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:14.807331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b8197-bb60-4ba4-b545-710c8e27ff6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:14.808374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-5e7b8197-bb60-4ba4-b545-710c8e27ff6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:14.808374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:14.808374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:14.809675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b8197-bb60-4ba4-b545-710c8e27ff6d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:14.923369 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 33/60] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:24:14 2021] POST /identity/v3/users => generated 275 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:24:18.395837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0eb99-92bf-41c9-9b8f-4cfb0c32cf5a None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.396878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0eb99-92bf-41c9-9b8f-4cfb0c32cf5a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.397361 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0eb99-92bf-41c9-9b8f-4cfb0c32cf5a None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.400245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 28/61] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:18.406411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9853a-adfb-47c5-96d5-b5a8f3f9e0b5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.407270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9853a-adfb-47c5-96d5-b5a8f3f9e0b5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.407739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9853a-adfb-47c5-96d5-b5a8f3f9e0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.433038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-aca9853a-adfb-47c5-96d5-b5a8f3f9e0b5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:18.434578 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-aca9853a-adfb-47c5-96d5-b5a8f3f9e0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:18.446678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 34/62] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:18.483320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0eb99-92bf-41c9-9b8f-4cfb0c32cf5a None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.499556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0eb99-92bf-41c9-9b8f-4cfb0c32cf5a None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.508327 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b132ed-9248-4cc0-a8ec-84c38d2f90a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.510076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b132ed-9248-4cc0-a8ec-84c38d2f90a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.510590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b132ed-9248-4cc0-a8ec-84c38d2f90a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.511064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b132ed-9248-4cc0-a8ec-84c38d2f90a5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.522299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b132ed-9248-4cc0-a8ec-84c38d2f90a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:18.529412 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-56b132ed-9248-4cc0-a8ec-84c38d2f90a5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:18.530832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 29/63] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:18.537630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9853a-adfb-47c5-96d5-b5a8f3f9e0b5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.551758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9853a-adfb-47c5-96d5-b5a8f3f9e0b5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.560235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda6c2e-7274-4040-9397-d8e46d80d721 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.560564 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda6c2e-7274-4040-9397-d8e46d80d721 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.560850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda6c2e-7274-4040-9397-d8e46d80d721 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.563686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 30/64] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:24:18.565917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe77895-0a88-45d7-8a10-64d6bd008380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.566602 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe77895-0a88-45d7-8a10-64d6bd008380 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.566892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe77895-0a88-45d7-8a10-64d6bd008380 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.567172 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe77895-0a88-45d7-8a10-64d6bd008380 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.568013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe77895-0a88-45d7-8a10-64d6bd008380 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:18.568570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe77895-0a88-45d7-8a10-64d6bd008380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.569409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2816f-dca9-427b-ab24-f395fd8b6e19 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.569844 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2816f-dca9-427b-ab24-f395fd8b6e19 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.570263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2816f-dca9-427b-ab24-f395fd8b6e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.573671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe77895-0a88-45d7-8a10-64d6bd008380 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.595747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 35/65] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:18.597046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe77895-0a88-45d7-8a10-64d6bd008380 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.598971 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-6cf2816f-dca9-427b-ab24-f395fd8b6e19 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:18.602001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6cf2816f-dca9-427b-ab24-f395fd8b6e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:18.610784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe77895-0a88-45d7-8a10-64d6bd008380 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.611522 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 31/66] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:18.613113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a04b1c-1f92-44fb-8ddc-108c2cf1aecb None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.613584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a04b1c-1f92-44fb-8ddc-108c2cf1aecb None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.613999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a04b1c-1f92-44fb-8ddc-108c2cf1aecb None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.616294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 32/67] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:18.621154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf696-225a-4e30-bc4a-8a99b3e1b657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.622296 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf696-225a-4e30-bc4a-8a99b3e1b657 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.622745 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf696-225a-4e30-bc4a-8a99b3e1b657 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.623164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf696-225a-4e30-bc4a-8a99b3e1b657 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.623517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4383-d3fc-487e-8d94-7e579c6b407d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.623815 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4383-d3fc-487e-8d94-7e579c6b407d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.624099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4383-d3fc-487e-8d94-7e579c6b407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.625252 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf696-225a-4e30-bc4a-8a99b3e1b657 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.632377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf696-225a-4e30-bc4a-8a99b3e1b657 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.632377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 36/68] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:18.642660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf696-225a-4e30-bc4a-8a99b3e1b657 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.658378 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ce8d4383-d3fc-487e-8d94-7e579c6b407d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:18.659756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ce8d4383-d3fc-487e-8d94-7e579c6b407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:18.660191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf696-225a-4e30-bc4a-8a99b3e1b657 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.665567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a95c7f-bb50-4ec8-8c0b-140865d3e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.666609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95c7f-bb50-4ec8-8c0b-140865d3e71a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.667131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95c7f-bb50-4ec8-8c0b-140865d3e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.667594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95c7f-bb50-4ec8-8c0b-140865d3e71a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.668500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 33/69] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:18.669622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4383-d3fc-487e-8d94-7e579c6b407d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.677420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a95c7f-bb50-4ec8-8c0b-140865d3e71a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.679619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a95c7f-bb50-4ec8-8c0b-140865d3e71a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.689880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 37/70] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:18.690349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4383-d3fc-487e-8d94-7e579c6b407d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.698584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15313dc-2d12-4153-acdb-ae5c9ff46755 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.699811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15313dc-2d12-4153-acdb-ae5c9ff46755 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.699811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15313dc-2d12-4153-acdb-ae5c9ff46755 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.701730 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 38/71] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:18 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:18.702327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15313dc-2d12-4153-acdb-ae5c9ff46755 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.703141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37ba8b-cfe8-4ba2-bc68-bfb006971cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.703941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37ba8b-cfe8-4ba2-bc68-bfb006971cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.704225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37ba8b-cfe8-4ba2-bc68-bfb006971cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.704539 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37ba8b-cfe8-4ba2-bc68-bfb006971cd4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.715646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37ba8b-cfe8-4ba2-bc68-bfb006971cd4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:18.718994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15313dc-2d12-4153-acdb-ae5c9ff46755 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.722461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-3a37ba8b-cfe8-4ba2-bc68-bfb006971cd4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:18.723289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1fc17-37ba-4e40-8776-90146e5b6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.728623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 34/72] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:18.728736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1fc17-37ba-4e40-8776-90146e5b6efe admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.728736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1fc17-37ba-4e40-8776-90146e5b6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.728887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37ba8b-cfe8-4ba2-bc68-bfb006971cd4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.728959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1fc17-37ba-4e40-8776-90146e5b6efe admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.729290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1fc17-37ba-4e40-8776-90146e5b6efe admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.731405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1fc17-37ba-4e40-8776-90146e5b6efe admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.733240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 39/73] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:18.734271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406767-afdd-4826-8f34-c64091812014 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.734557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406767-afdd-4826-8f34-c64091812014 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.735017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406767-afdd-4826-8f34-c64091812014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.739318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37ba8b-cfe8-4ba2-bc68-bfb006971cd4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.744455 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ab1f8-d50e-4e52-a653-52610ec6d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.745255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ab1f8-d50e-4e52-a653-52610ec6d429 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.745537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ab1f8-d50e-4e52-a653-52610ec6d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.745812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ab1f8-d50e-4e52-a653-52610ec6d429 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.753658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7a406767-afdd-4826-8f34-c64091812014 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:18.754882 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7a406767-afdd-4826-8f34-c64091812014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:18.756669 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ab1f8-d50e-4e52-a653-52610ec6d429 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:18.763433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 40/74] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:18.764515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-563ab1f8-d50e-4e52-a653-52610ec6d429 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:18.765795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 35/75] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:18.771242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ab1f8-d50e-4e52-a653-52610ec6d429 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.773224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a406767-afdd-4826-8f34-c64091812014 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.781060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ab1f8-d50e-4e52-a653-52610ec6d429 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.784912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a406767-afdd-4826-8f34-c64091812014 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.785613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef325d-2eb0-4d19-ae94-d36af733e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.786342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef325d-2eb0-4d19-ae94-d36af733e7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.786630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef325d-2eb0-4d19-ae94-d36af733e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.786907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef325d-2eb0-4d19-ae94-d36af733e7d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.787737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef325d-2eb0-4d19-ae94-d36af733e7d0 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6, user.id=a3eedbef815445d78eda15afd8ed2501) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:18.788049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef325d-2eb0-4d19-ae94-d36af733e7d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.789086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-7fef325d-2eb0-4d19-ae94-d36af733e7d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:18.789086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:18.789086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:18.790788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef325d-2eb0-4d19-ae94-d36af733e7d0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.790967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253991f-fb09-42ff-a9bd-100913bca940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.791628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253991f-fb09-42ff-a9bd-100913bca940 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.791917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253991f-fb09-42ff-a9bd-100913bca940 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.792196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253991f-fb09-42ff-a9bd-100913bca940 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.792985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253991f-fb09-42ff-a9bd-100913bca940 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:18.793294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253991f-fb09-42ff-a9bd-100913bca940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.795195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253991f-fb09-42ff-a9bd-100913bca940 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.798092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 36/76] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/role_assignments?user.id=a3eedbef815445d78eda15afd8ed2501&scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:18.799043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef325d-2eb0-4d19-ae94-d36af733e7d0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.809826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef325d-2eb0-4d19-ae94-d36af733e7d0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.818116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 41/77] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:18.818116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253991f-fb09-42ff-a9bd-100913bca940 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.821245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637fc41-3db9-4b9d-9bcb-44a026c3948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.822388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637fc41-3db9-4b9d-9bcb-44a026c3948d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.822890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637fc41-3db9-4b9d-9bcb-44a026c3948d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.823388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637fc41-3db9-4b9d-9bcb-44a026c3948d admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.824467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637fc41-3db9-4b9d-9bcb-44a026c3948d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:18.825005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637fc41-3db9-4b9d-9bcb-44a026c3948d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.827002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637fc41-3db9-4b9d-9bcb-44a026c3948d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.828039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253991f-fb09-42ff-a9bd-100913bca940 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.833750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4f956-10c8-44f4-be56-d0ef831c2322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.834590 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4f956-10c8-44f4-be56-d0ef831c2322 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.834879 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4f956-10c8-44f4-be56-d0ef831c2322 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.835160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4f956-10c8-44f4-be56-d0ef831c2322 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.837713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4f956-10c8-44f4-be56-d0ef831c2322 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.839939 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4f956-10c8-44f4-be56-d0ef831c2322 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.840408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 37/78] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:18.841487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637fc41-3db9-4b9d-9bcb-44a026c3948d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.844541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 42/79] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:18.848553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4f956-10c8-44f4-be56-d0ef831c2322 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.859543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637fc41-3db9-4b9d-9bcb-44a026c3948d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.863026 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4f956-10c8-44f4-be56-d0ef831c2322 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.865773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c5350-16d3-402c-a722-d2606f70297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.867085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c5350-16d3-402c-a722-d2606f70297f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.867488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c5350-16d3-402c-a722-d2606f70297f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.868533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c5350-16d3-402c-a722-d2606f70297f admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.869251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a263e-c069-4e7f-89d1-912c95d7af54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.870148 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a263e-c069-4e7f-89d1-912c95d7af54 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.870570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a263e-c069-4e7f-89d1-912c95d7af54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.870978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a263e-c069-4e7f-89d1-912c95d7af54 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.871918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a263e-c069-4e7f-89d1-912c95d7af54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.874146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a263e-c069-4e7f-89d1-912c95d7af54 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.888603 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c5350-16d3-402c-a722-d2606f70297f admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.892205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c5350-16d3-402c-a722-d2606f70297f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.894361 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 38/80] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:18.895084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c5350-16d3-402c-a722-d2606f70297f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.906568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c5350-16d3-402c-a722-d2606f70297f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.911302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaac0b2-0716-40d7-86cb-e23b98a720e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.912133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaac0b2-0716-40d7-86cb-e23b98a720e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.912520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaac0b2-0716-40d7-86cb-e23b98a720e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.912904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaac0b2-0716-40d7-86cb-e23b98a720e0 admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.914175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaac0b2-0716-40d7-86cb-e23b98a720e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.917033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaac0b2-0716-40d7-86cb-e23b98a720e0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.919085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 39/81] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:18.919885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaac0b2-0716-40d7-86cb-e23b98a720e0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.931080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaac0b2-0716-40d7-86cb-e23b98a720e0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:18.936266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5f108-89d9-494a-a273-2bea6dcf4041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:18.937071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f108-89d9-494a-a273-2bea6dcf4041 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.937360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f108-89d9-494a-a273-2bea6dcf4041 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.937639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f108-89d9-494a-a273-2bea6dcf4041 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.946853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5f108-89d9-494a-a273-2bea6dcf4041 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:18.948932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5f108-89d9-494a-a273-2bea6dcf4041 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:18.962155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 43/82] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:24:18 2021] POST /identity/v3/projects => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:18.962367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 40/83] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:18.963582 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a263e-c069-4e7f-89d1-912c95d7af54 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:18.964209 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa7bc-ab8e-4006-aec7-e48b83a338e2 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:18.964690 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa7bc-ab8e-4006-aec7-e48b83a338e2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:18.965098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa7bc-ab8e-4006-aec7-e48b83a338e2 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:18.967544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 41/84] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:18.973483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa7bc-ab8e-4006-aec7-e48b83a338e2 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:19.054189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a263e-c069-4e7f-89d1-912c95d7af54 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.059016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa7bc-ab8e-4006-aec7-e48b83a338e2 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.060107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce01f-819f-4f33-aa43-4f68bb6b1576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.061196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce01f-819f-4f33-aa43-4f68bb6b1576 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.061756 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce01f-819f-4f33-aa43-4f68bb6b1576 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.062229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce01f-819f-4f33-aa43-4f68bb6b1576 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.064468 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58537321-a8fd-49cb-aa2b-832e8fde814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.065489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537321-a8fd-49cb-aa2b-832e8fde814b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.065851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537321-a8fd-49cb-aa2b-832e8fde814b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.066203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537321-a8fd-49cb-aa2b-832e8fde814b admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.067531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58537321-a8fd-49cb-aa2b-832e8fde814b admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:19.070078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58537321-a8fd-49cb-aa2b-832e8fde814b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:19.073090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce01f-819f-4f33-aa43-4f68bb6b1576 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:19.075239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce01f-819f-4f33-aa43-4f68bb6b1576 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:19.078653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 42/85] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:19.080481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26a6db-f0cf-4c02-8a2d-9aa243991716 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.080781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26a6db-f0cf-4c02-8a2d-9aa243991716 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.081064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26a6db-f0cf-4c02-8a2d-9aa243991716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.086654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 44/86] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:19.088211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce01f-819f-4f33-aa43-4f68bb6b1576 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:19.098567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce01f-819f-4f33-aa43-4f68bb6b1576 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.104072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-cc26a6db-f0cf-4c02-8a2d-9aa243991716 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:19.104802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f37071-d674-466d-95cf-90f1fc000726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.105401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-cc26a6db-f0cf-4c02-8a2d-9aa243991716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:19.105925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f37071-d674-466d-95cf-90f1fc000726 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.106431 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f37071-d674-466d-95cf-90f1fc000726 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.106929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f37071-d674-466d-95cf-90f1fc000726 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.108117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f37071-d674-466d-95cf-90f1fc000726 admin admin] RBAC: Adding query filter params (role.id=70600290909e4c808126b1efb2142b05, scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6, user.id=6996fd7dbb564d26aa210e18c1319348) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:19.108752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f37071-d674-466d-95cf-90f1fc000726 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:19.110880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f37071-d674-466d-95cf-90f1fc000726 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:19.120392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 43/87] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:19.120392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26a6db-f0cf-4c02-8a2d-9aa243991716 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:19.126307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26a6db-f0cf-4c02-8a2d-9aa243991716 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.127167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 45/88] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:19 2021] GET /identity/v3/role_assignments?user.id=6996fd7dbb564d26aa210e18c1319348&scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6&role.id=70600290909e4c808126b1efb2142b05 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:19.145368 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f37071-d674-466d-95cf-90f1fc000726 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:19.146329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79863b4-5712-4628-bce5-96ffac163b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.147415 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79863b4-5712-4628-bce5-96ffac163b34 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.147850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79863b4-5712-4628-bce5-96ffac163b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.148266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79863b4-5712-4628-bce5-96ffac163b34 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.149887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79863b4-5712-4628-bce5-96ffac163b34 admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:19.152281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79863b4-5712-4628-bce5-96ffac163b34 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:19.154382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 44/89] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:19 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:19.160083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f37071-d674-466d-95cf-90f1fc000726 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.162128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79863b4-5712-4628-bce5-96ffac163b34 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:19.169156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c632293-4289-4559-83d1-011e5decdd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.170074 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632293-4289-4559-83d1-011e5decdd04 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.170431 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632293-4289-4559-83d1-011e5decdd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.170959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632293-4289-4559-83d1-011e5decdd04 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.176242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79863b4-5712-4628-bce5-96ffac163b34 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.183078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fc87e-206d-42cc-a939-98c7e2ce2da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.183752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fc87e-206d-42cc-a939-98c7e2ce2da9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.184041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fc87e-206d-42cc-a939-98c7e2ce2da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.184324 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fc87e-206d-42cc-a939-98c7e2ce2da9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.185527 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fc87e-206d-42cc-a939-98c7e2ce2da9 admin admin] RBAC: Adding query filter params (role.id=3df7162472e345bd91ce9469ee6fe3f5, scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6, user.id=6996fd7dbb564d26aa210e18c1319348) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:19.185850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fc87e-206d-42cc-a939-98c7e2ce2da9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:19.186228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c632293-4289-4559-83d1-011e5decdd04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:19.187754 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fc87e-206d-42cc-a939-98c7e2ce2da9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:19.194107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 45/90] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:19 2021] GET /identity/v3/role_assignments?user.id=6996fd7dbb564d26aa210e18c1319348&scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6&role.id=3df7162472e345bd91ce9469ee6fe3f5 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:19.194853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-8c632293-4289-4559-83d1-011e5decdd04 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:19.200405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 46/91] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:19.207466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fc87e-206d-42cc-a939-98c7e2ce2da9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:19.219180 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fc87e-206d-42cc-a939-98c7e2ce2da9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.224584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c515f59-57da-453a-a801-e71efe0b5f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.225574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c515f59-57da-453a-a801-e71efe0b5f7e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.226095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c515f59-57da-453a-a801-e71efe0b5f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.226539 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c515f59-57da-453a-a801-e71efe0b5f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.228147 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c515f59-57da-453a-a801-e71efe0b5f7e admin admin] RBAC: Adding query filter params (name=member) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:19.228662 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c515f59-57da-453a-a801-e71efe0b5f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:19.230559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c515f59-57da-453a-a801-e71efe0b5f7e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:19.243338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 46/92] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:19.252289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c632293-4289-4559-83d1-011e5decdd04 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:19.263339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c632293-4289-4559-83d1-011e5decdd04 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.268135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97ad5c-d053-4e01-8ce4-57b804c54eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.269071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97ad5c-d053-4e01-8ce4-57b804c54eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.269356 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97ad5c-d053-4e01-8ce4-57b804c54eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.269628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97ad5c-d053-4e01-8ce4-57b804c54eb2 admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.270948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97ad5c-d053-4e01-8ce4-57b804c54eb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:19.273293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97ad5c-d053-4e01-8ce4-57b804c54eb2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:19.280859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 47/93] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:19 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:19.283633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c515f59-57da-453a-a801-e71efe0b5f7e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:19.295853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c515f59-57da-453a-a801-e71efe0b5f7e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.301059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3a3b2-5ec8-40be-88da-9016f306cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.301744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3a3b2-5ec8-40be-88da-9016f306cdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.302027 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3a3b2-5ec8-40be-88da-9016f306cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.302306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3a3b2-5ec8-40be-88da-9016f306cdb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.311514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3a3b2-5ec8-40be-88da-9016f306cdb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:19.313397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3a3b2-5ec8-40be-88da-9016f306cdb7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:19.323820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 47/94] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:19.331075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97ad5c-d053-4e01-8ce4-57b804c54eb2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:19.342968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97ad5c-d053-4e01-8ce4-57b804c54eb2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.351811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226d50f-acd2-4ded-a880-c4fe9a752d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.353270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226d50f-acd2-4ded-a880-c4fe9a752d82 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.353563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226d50f-acd2-4ded-a880-c4fe9a752d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.353895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226d50f-acd2-4ded-a880-c4fe9a752d82 admin admin] PATH_INFO: `/v3/projects/9b9245eaa111477eacd21e257b36b348` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.355943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226d50f-acd2-4ded-a880-c4fe9a752d82 admin admin] RBAC: Authorizing `identity:get_project(project_id=9b9245eaa111477eacd21e257b36b348)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:19.358139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226d50f-acd2-4ded-a880-c4fe9a752d82 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:19.360105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 48/95] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:19 2021] GET /identity/v3/projects/9b9245eaa111477eacd21e257b36b348 => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:19.368258 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3a3b2-5ec8-40be-88da-9016f306cdb7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:19.379867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3a3b2-5ec8-40be-88da-9016f306cdb7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:19.386178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dbf25-3131-4201-b222-b28dd83c4bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:19.386864 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dbf25-3131-4201-b222-b28dd83c4bea admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:19.387195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dbf25-3131-4201-b222-b28dd83c4bea admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:19.387524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dbf25-3131-4201-b222-b28dd83c4bea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:19.388416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dbf25-3131-4201-b222-b28dd83c4bea admin admin] RBAC: Adding query filter params (role.id=70600290909e4c808126b1efb2142b05, scope.project.id=9b9245eaa111477eacd21e257b36b348, user.id=6996fd7dbb564d26aa210e18c1319348) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:19.388741 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dbf25-3131-4201-b222-b28dd83c4bea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:19.390678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dbf25-3131-4201-b222-b28dd83c4bea admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:19.397289 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 48/96] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:19 2021] GET /identity/v3/role_assignments?user.id=6996fd7dbb564d26aa210e18c1319348&scope.project.id=9b9245eaa111477eacd21e257b36b348&role.id=70600290909e4c808126b1efb2142b05 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:21.445358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c322972-4d7e-42e9-841d-385e31bb3802 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.446241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c322972-4d7e-42e9-841d-385e31bb3802 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.446241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c322972-4d7e-42e9-841d-385e31bb3802 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.448010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 49/97] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:21.454316 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354ab3-a7f9-4487-92fa-4c2fc98d80ee None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.454774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354ab3-a7f9-4487-92fa-4c2fc98d80ee None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.454944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354ab3-a7f9-4487-92fa-4c2fc98d80ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.481492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-51354ab3-a7f9-4487-92fa-4c2fc98d80ee None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:21.482703 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-51354ab3-a7f9-4487-92fa-4c2fc98d80ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:21.490764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 49/98] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:21.530406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c322972-4d7e-42e9-841d-385e31bb3802 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:21.545993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c322972-4d7e-42e9-841d-385e31bb3802 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:21.550523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7d317-b9ff-4470-a3db-bc371253f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:21.551315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7d317-b9ff-4470-a3db-bc371253f4fb admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.551602 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7d317-b9ff-4470-a3db-bc371253f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.551878 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7d317-b9ff-4470-a3db-bc371253f4fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.573991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7d317-b9ff-4470-a3db-bc371253f4fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:21.580836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-faf7d317-b9ff-4470-a3db-bc371253f4fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:21.582064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 50/99] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:21.589119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51354ab3-a7f9-4487-92fa-4c2fc98d80ee None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:21.598321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51354ab3-a7f9-4487-92fa-4c2fc98d80ee None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:21.608650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea8706-9e95-4321-a0a0-f7c2d5ac5d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:21.609334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8706-9e95-4321-a0a0-f7c2d5ac5d06 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.609621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8706-9e95-4321-a0a0-f7c2d5ac5d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.609898 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8706-9e95-4321-a0a0-f7c2d5ac5d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.610663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea8706-9e95-4321-a0a0-f7c2d5ac5d06 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:21.610971 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea8706-9e95-4321-a0a0-f7c2d5ac5d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:21.612630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea8706-9e95-4321-a0a0-f7c2d5ac5d06 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:21.621659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 50/100] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:21.628329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7d317-b9ff-4470-a3db-bc371253f4fb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:21.638265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7d317-b9ff-4470-a3db-bc371253f4fb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:21.649693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081209aa-9672-4eb9-838a-4f0d9bc20738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:21.650774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081209aa-9672-4eb9-838a-4f0d9bc20738 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.651166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081209aa-9672-4eb9-838a-4f0d9bc20738 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.651475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081209aa-9672-4eb9-838a-4f0d9bc20738 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.657216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081209aa-9672-4eb9-838a-4f0d9bc20738 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:21.659121 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081209aa-9672-4eb9-838a-4f0d9bc20738 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:21.660844 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 51/101] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:21 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:21.668410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea8706-9e95-4321-a0a0-f7c2d5ac5d06 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:21.678918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea8706-9e95-4321-a0a0-f7c2d5ac5d06 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:21.689286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3190fd-36eb-4fc1-990e-be1900a70927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:21.690199 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3190fd-36eb-4fc1-990e-be1900a70927 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.690473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3190fd-36eb-4fc1-990e-be1900a70927 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.690755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3190fd-36eb-4fc1-990e-be1900a70927 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.694591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3190fd-36eb-4fc1-990e-be1900a70927 admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:21.698675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3190fd-36eb-4fc1-990e-be1900a70927 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:21.698675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 51/102] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:21 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:21.705479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081209aa-9672-4eb9-838a-4f0d9bc20738 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:21.723937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081209aa-9672-4eb9-838a-4f0d9bc20738 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:21.730045 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaba7b7-4eab-44ca-bbaa-10d2abd849a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:21.730960 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba7b7-4eab-44ca-bbaa-10d2abd849a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.731244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba7b7-4eab-44ca-bbaa-10d2abd849a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.731519 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba7b7-4eab-44ca-bbaa-10d2abd849a5 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6/users/a3eedbef815445d78eda15afd8ed2501/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.738156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaba7b7-4eab-44ca-bbaa-10d2abd849a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5d1c3997b74a6dadceb4fb555cf0e6, user_id=a3eedbef815445d78eda15afd8ed2501, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:21.741016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaba7b7-4eab-44ca-bbaa-10d2abd849a5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:21.806872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671483d1-0e86-40b6-adcd-cf084e3f0125 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.807277 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671483d1-0e86-40b6-adcd-cf084e3f0125 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.807543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671483d1-0e86-40b6-adcd-cf084e3f0125 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.809643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 52/103] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:21.816679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707fb2f-42ad-4337-8ec7-2b59496056f8 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.817100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707fb2f-42ad-4337-8ec7-2b59496056f8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.817382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707fb2f-42ad-4337-8ec7-2b59496056f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.823662 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 52/104] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:21 2021] PUT /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6/users/a3eedbef815445d78eda15afd8ed2501/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:21.852019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-0707fb2f-42ad-4337-8ec7-2b59496056f8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:21.853292 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0707fb2f-42ad-4337-8ec7-2b59496056f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:21.900585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3873478-e8b4-4a48-894b-68e7d161f99e None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.900905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3873478-e8b4-4a48-894b-68e7d161f99e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.901381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3873478-e8b4-4a48-894b-68e7d161f99e None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.903567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 53/105] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:21.909671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfafb9-024c-4bad-8dc3-947c9d0deacb None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.909985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfafb9-024c-4bad-8dc3-947c9d0deacb None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.910236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfafb9-024c-4bad-8dc3-947c9d0deacb None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.912090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 54/106] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:21.917545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494f308-1351-4b11-98fa-3d4208625340 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.917852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494f308-1351-4b11-98fa-3d4208625340 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.918116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494f308-1351-4b11-98fa-3d4208625340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.932161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 53/107] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:21.940379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360797c3-bcc2-438a-ba20-c821ba6caa6f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:21.941119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360797c3-bcc2-438a-ba20-c821ba6caa6f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:21.941570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360797c3-bcc2-438a-ba20-c821ba6caa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:21.946678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c494f308-1351-4b11-98fa-3d4208625340 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:21.948245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c494f308-1351-4b11-98fa-3d4208625340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:21.957890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 55/108] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:21.978568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-360797c3-bcc2-438a-ba20-c821ba6caa6f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:21.979811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494f308-1351-4b11-98fa-3d4208625340 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:21.980223 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-360797c3-bcc2-438a-ba20-c821ba6caa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:21.993112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 54/109] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:21.994387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360797c3-bcc2-438a-ba20-c821ba6caa6f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.002445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494f308-1351-4b11-98fa-3d4208625340 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.004615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360797c3-bcc2-438a-ba20-c821ba6caa6f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.014670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f561aa0-11ee-4d65-a1b5-de239eefd25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.016418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e10278-27f3-457d-89a5-fcc5e2c18868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.017394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561aa0-11ee-4d65-a1b5-de239eefd25a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.018464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e10278-27f3-457d-89a5-fcc5e2c18868 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.018937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561aa0-11ee-4d65-a1b5-de239eefd25a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.019357 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561aa0-11ee-4d65-a1b5-de239eefd25a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.019791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e10278-27f3-457d-89a5-fcc5e2c18868 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.020709 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e10278-27f3-457d-89a5-fcc5e2c18868 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.025008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e10278-27f3-457d-89a5-fcc5e2c18868 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.028467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e10278-27f3-457d-89a5-fcc5e2c18868 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.030917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 55/110] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:22.032395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e10278-27f3-457d-89a5-fcc5e2c18868 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.037154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f561aa0-11ee-4d65-a1b5-de239eefd25a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:22.046241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-7f561aa0-11ee-4d65-a1b5-de239eefd25a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:22.047762 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 56/111] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:22.048291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f561aa0-11ee-4d65-a1b5-de239eefd25a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.055641 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e10278-27f3-457d-89a5-fcc5e2c18868 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.060881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691df2f-e69d-4f49-b1d2-c63406ff552f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.061803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691df2f-e69d-4f49-b1d2-c63406ff552f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.062165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691df2f-e69d-4f49-b1d2-c63406ff552f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.062521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691df2f-e69d-4f49-b1d2-c63406ff552f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.067855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f561aa0-11ee-4d65-a1b5-de239eefd25a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.073877 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212b1ad-d4a8-4e56-ac61-2cc9c7eda599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.074910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212b1ad-d4a8-4e56-ac61-2cc9c7eda599 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.075333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212b1ad-d4a8-4e56-ac61-2cc9c7eda599 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.075870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212b1ad-d4a8-4e56-ac61-2cc9c7eda599 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.076092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691df2f-e69d-4f49-b1d2-c63406ff552f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:22.076899 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212b1ad-d4a8-4e56-ac61-2cc9c7eda599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.079012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212b1ad-d4a8-4e56-ac61-2cc9c7eda599 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.086111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-9691df2f-e69d-4f49-b1d2-c63406ff552f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:22.088391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 56/112] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:22.089168 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691df2f-e69d-4f49-b1d2-c63406ff552f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.100267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691df2f-e69d-4f49-b1d2-c63406ff552f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.104868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f58df-09d5-4805-9466-da1666ee28d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.105527 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f58df-09d5-4805-9466-da1666ee28d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.105826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f58df-09d5-4805-9466-da1666ee28d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.106097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f58df-09d5-4805-9466-da1666ee28d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.106853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f58df-09d5-4805-9466-da1666ee28d6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:22.107188 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f58df-09d5-4805-9466-da1666ee28d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.108853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f58df-09d5-4805-9466-da1666ee28d6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.117621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 57/113] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:22.118678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f58df-09d5-4805-9466-da1666ee28d6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.128454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f58df-09d5-4805-9466-da1666ee28d6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.134076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afc18a-0151-4b38-a064-9c0f87cf8c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.134842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afc18a-0151-4b38-a064-9c0f87cf8c94 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.135215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afc18a-0151-4b38-a064-9c0f87cf8c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.135520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afc18a-0151-4b38-a064-9c0f87cf8c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.136384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afc18a-0151-4b38-a064-9c0f87cf8c94 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:22.136702 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afc18a-0151-4b38-a064-9c0f87cf8c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.138318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afc18a-0151-4b38-a064-9c0f87cf8c94 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.146768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 58/114] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:22.148005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67edd64-a8c0-4a2d-9bf8-57d7c567e442 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.148298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67edd64-a8c0-4a2d-9bf8-57d7c567e442 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.148612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67edd64-a8c0-4a2d-9bf8-57d7c567e442 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.150802 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 59/115] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:22.152489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67edd64-a8c0-4a2d-9bf8-57d7c567e442 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.164519 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67edd64-a8c0-4a2d-9bf8-57d7c567e442 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.169360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e686b-e36c-44a0-9745-4d6deab6c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.170205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e686b-e36c-44a0-9745-4d6deab6c40b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.170485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e686b-e36c-44a0-9745-4d6deab6c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.170812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e686b-e36c-44a0-9745-4d6deab6c40b admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.172009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e686b-e36c-44a0-9745-4d6deab6c40b admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.174228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e686b-e36c-44a0-9745-4d6deab6c40b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.175799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 60/116] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:22.177213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e686b-e36c-44a0-9745-4d6deab6c40b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.188491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 57/117] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:24:22 2021] POST /identity/v3/users => generated 283 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:22.189939 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e686b-e36c-44a0-9745-4d6deab6c40b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.194639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4e723-ea19-4998-9d57-7f278b17b879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.195682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e723-ea19-4998-9d57-7f278b17b879 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.204118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e723-ea19-4998-9d57-7f278b17b879 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.204118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e723-ea19-4998-9d57-7f278b17b879 admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.204327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47ab2a-2251-4e8d-a69d-cc048e721f63 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.204429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4e723-ea19-4998-9d57-7f278b17b879 admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.204520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47ab2a-2251-4e8d-a69d-cc048e721f63 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.204520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47ab2a-2251-4e8d-a69d-cc048e721f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.204639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4e723-ea19-4998-9d57-7f278b17b879 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.204639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 61/118] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:22.204639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4e723-ea19-4998-9d57-7f278b17b879 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.216832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4e723-ea19-4998-9d57-7f278b17b879 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.222139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b94f1-5f06-4cc3-929d-da79ca2ac4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.223457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b94f1-5f06-4cc3-929d-da79ca2ac4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.223983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b94f1-5f06-4cc3-929d-da79ca2ac4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.224499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b94f1-5f06-4cc3-929d-da79ca2ac4b3 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.227260 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b94f1-5f06-4cc3-929d-da79ca2ac4b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.232638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b94f1-5f06-4cc3-929d-da79ca2ac4b3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.234998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 62/119] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:22.235668 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b94f1-5f06-4cc3-929d-da79ca2ac4b3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.235951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0c47ab2a-2251-4e8d-a69d-cc048e721f63 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:22.237641 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0c47ab2a-2251-4e8d-a69d-cc048e721f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:22.248885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 58/120] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:22.253736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b94f1-5f06-4cc3-929d-da79ca2ac4b3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.254971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47ab2a-2251-4e8d-a69d-cc048e721f63 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.258469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f238e8-654b-486e-874f-dd59adb96d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.259910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f238e8-654b-486e-874f-dd59adb96d18 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.260198 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f238e8-654b-486e-874f-dd59adb96d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.260520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f238e8-654b-486e-874f-dd59adb96d18 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.261956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f238e8-654b-486e-874f-dd59adb96d18 admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.264103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f238e8-654b-486e-874f-dd59adb96d18 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.269790 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 63/121] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:22.274665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f238e8-654b-486e-874f-dd59adb96d18 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.282074 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47ab2a-2251-4e8d-a69d-cc048e721f63 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.290844 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f238e8-654b-486e-874f-dd59adb96d18 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.294485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4404-7623-456d-b507-620dfc9e2f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.295398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4404-7623-456d-b507-620dfc9e2f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.295716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4404-7623-456d-b507-620dfc9e2f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.295998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4404-7623-456d-b507-620dfc9e2f43 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6/users/6996fd7dbb564d26aa210e18c1319348/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.298116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b4404-7623-456d-b507-620dfc9e2f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5d1c3997b74a6dadceb4fb555cf0e6, user_id=6996fd7dbb564d26aa210e18c1319348, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.300541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b9bc9-ca05-4007-9a99-c7eb07608b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.300894 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b4404-7623-456d-b507-620dfc9e2f43 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.301974 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b9bc9-ca05-4007-9a99-c7eb07608b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.302513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b9bc9-ca05-4007-9a99-c7eb07608b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.303043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b9bc9-ca05-4007-9a99-c7eb07608b7f admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6/users/6996fd7dbb564d26aa210e18c1319348/roles/3df7162472e345bd91ce9469ee6fe3f5` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.306628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b9bc9-ca05-4007-9a99-c7eb07608b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5d1c3997b74a6dadceb4fb555cf0e6, user_id=6996fd7dbb564d26aa210e18c1319348, role_id=3df7162472e345bd91ce9469ee6fe3f5)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.308111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-0c4b9bc9-ca05-4007-9a99-c7eb07608b7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:22.308111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:22.308111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:22.310752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b9bc9-ca05-4007-9a99-c7eb07608b7f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.400495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 59/122] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:22 2021] PUT /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6/users/6996fd7dbb564d26aa210e18c1319348/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:22.401329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4404-7623-456d-b507-620dfc9e2f43 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.435777 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 64/123] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:22 2021] PUT /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6/users/6996fd7dbb564d26aa210e18c1319348/roles/3df7162472e345bd91ce9469ee6fe3f5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:22.487352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4404-7623-456d-b507-620dfc9e2f43 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.554643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b486a-6245-45a8-a33d-89d672c4cb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.556185 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b486a-6245-45a8-a33d-89d672c4cb7e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.556506 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b486a-6245-45a8-a33d-89d672c4cb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.556788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b486a-6245-45a8-a33d-89d672c4cb7e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.569997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b486a-6245-45a8-a33d-89d672c4cb7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:22.577459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-553b486a-6245-45a8-a33d-89d672c4cb7e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:22.582319 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 60/124] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:22.586080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b9bc9-ca05-4007-9a99-c7eb07608b7f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.597918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b9bc9-ca05-4007-9a99-c7eb07608b7f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.605274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2f133-25be-4ccd-a5da-d7e593b752ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.605703 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2f133-25be-4ccd-a5da-d7e593b752ab admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.606043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2f133-25be-4ccd-a5da-d7e593b752ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.606324 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2f133-25be-4ccd-a5da-d7e593b752ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.607193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2f133-25be-4ccd-a5da-d7e593b752ab admin admin] RBAC: Adding query filter params (name=member) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:22.607615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2f133-25be-4ccd-a5da-d7e593b752ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.609400 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2f133-25be-4ccd-a5da-d7e593b752ab admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.620915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 65/125] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:22.627605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b486a-6245-45a8-a33d-89d672c4cb7e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.639948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b486a-6245-45a8-a33d-89d672c4cb7e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.645552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ec71b-ff62-45c3-a698-c6ecdaf6c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.646426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ec71b-ff62-45c3-a698-c6ecdaf6c1ad admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.646709 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ec71b-ff62-45c3-a698-c6ecdaf6c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.647038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ec71b-ff62-45c3-a698-c6ecdaf6c1ad admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.650080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ec71b-ff62-45c3-a698-c6ecdaf6c1ad admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.652294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ec71b-ff62-45c3-a698-c6ecdaf6c1ad admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.654186 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 61/126] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:22.660395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2f133-25be-4ccd-a5da-d7e593b752ab admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.675470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2f133-25be-4ccd-a5da-d7e593b752ab admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.684641 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb6164-9a86-4391-b2a7-96e3280e9fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.685750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb6164-9a86-4391-b2a7-96e3280e9fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.686183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb6164-9a86-4391-b2a7-96e3280e9fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.686632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb6164-9a86-4391-b2a7-96e3280e9fd9 admin admin] PATH_INFO: `/v3/projects/9b9245eaa111477eacd21e257b36b348` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.688028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb6164-9a86-4391-b2a7-96e3280e9fd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=9b9245eaa111477eacd21e257b36b348)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.690338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb6164-9a86-4391-b2a7-96e3280e9fd9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.692256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 66/127] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/projects/9b9245eaa111477eacd21e257b36b348 => generated 312 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:22.699081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ec71b-ff62-45c3-a698-c6ecdaf6c1ad admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.712961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ec71b-ff62-45c3-a698-c6ecdaf6c1ad admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.717612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc24a88-21f4-40e2-9b2e-e0fee49a4673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.718522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24a88-21f4-40e2-9b2e-e0fee49a4673 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.718788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24a88-21f4-40e2-9b2e-e0fee49a4673 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.719058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24a88-21f4-40e2-9b2e-e0fee49a4673 admin admin] PATH_INFO: `/v3/projects/9b9245eaa111477eacd21e257b36b348/users/6996fd7dbb564d26aa210e18c1319348/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.724927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc24a88-21f4-40e2-9b2e-e0fee49a4673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9245eaa111477eacd21e257b36b348, user_id=6996fd7dbb564d26aa210e18c1319348, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.728200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc24a88-21f4-40e2-9b2e-e0fee49a4673 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.817176 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 62/128] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:22 2021] PUT /identity/v3/projects/9b9245eaa111477eacd21e257b36b348/users/6996fd7dbb564d26aa210e18c1319348/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:24.498391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2084b-7dd8-4d4e-9e62-6046c29c1e30 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:24.499422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2084b-7dd8-4d4e-9e62-6046c29c1e30 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:24.499915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2084b-7dd8-4d4e-9e62-6046c29c1e30 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:24.501924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 67/129] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:24.508098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30babe-424a-4304-bbf2-a86b8410cc8c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:24.509018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30babe-424a-4304-bbf2-a86b8410cc8c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:24.509497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30babe-424a-4304-bbf2-a86b8410cc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:24.537390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-cd30babe-424a-4304-bbf2-a86b8410cc8c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:24.538989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-cd30babe-424a-4304-bbf2-a86b8410cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:24.609731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 63/130] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:24.666969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2084b-7dd8-4d4e-9e62-6046c29c1e30 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:24.682384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2084b-7dd8-4d4e-9e62-6046c29c1e30 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:24.691445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc06030-f811-4dbf-ab3d-48561aab06ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:24.692605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc06030-f811-4dbf-ab3d-48561aab06ee admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:24.693118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc06030-f811-4dbf-ab3d-48561aab06ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:24.693614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc06030-f811-4dbf-ab3d-48561aab06ee admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:24.710375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc06030-f811-4dbf-ab3d-48561aab06ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:24.717816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-bfc06030-f811-4dbf-ab3d-48561aab06ee admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:24.719330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 68/131] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:24.725546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30babe-424a-4304-bbf2-a86b8410cc8c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:24.741398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30babe-424a-4304-bbf2-a86b8410cc8c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:24.746086 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69510e1-1de7-4130-b712-ce340e0e0483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:24.746774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69510e1-1de7-4130-b712-ce340e0e0483 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:24.747051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69510e1-1de7-4130-b712-ce340e0e0483 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:24.747337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69510e1-1de7-4130-b712-ce340e0e0483 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:24.748101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69510e1-1de7-4130-b712-ce340e0e0483 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:24.748499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69510e1-1de7-4130-b712-ce340e0e0483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:24.750078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69510e1-1de7-4130-b712-ce340e0e0483 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:24.763904 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 64/132] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:24.770189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc06030-f811-4dbf-ab3d-48561aab06ee admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:24.781808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc06030-f811-4dbf-ab3d-48561aab06ee admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:24.790466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0acd9-62ef-4d2b-9d53-830356b5a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:24.791348 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0acd9-62ef-4d2b-9d53-830356b5a675 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:24.791635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0acd9-62ef-4d2b-9d53-830356b5a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:24.791917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0acd9-62ef-4d2b-9d53-830356b5a675 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:24.793163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0acd9-62ef-4d2b-9d53-830356b5a675 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:24.795267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0acd9-62ef-4d2b-9d53-830356b5a675 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:24.796912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 69/133] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:24 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:24.803525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69510e1-1de7-4130-b712-ce340e0e0483 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:24.817340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69510e1-1de7-4130-b712-ce340e0e0483 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:24.825537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f49e-5651-4c5f-9a80-6ca9b215273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:24.826193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f49e-5651-4c5f-9a80-6ca9b215273b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:24.826488 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f49e-5651-4c5f-9a80-6ca9b215273b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:24.826771 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f49e-5651-4c5f-9a80-6ca9b215273b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:24.840542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456f49e-5651-4c5f-9a80-6ca9b215273b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:24.842353 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456f49e-5651-4c5f-9a80-6ca9b215273b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:24.858330 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 65/134] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:24.864602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0acd9-62ef-4d2b-9d53-830356b5a675 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:24.874696 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0acd9-62ef-4d2b-9d53-830356b5a675 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:24.885092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698364d8-be97-4462-aba2-d838bf052f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:24.885974 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698364d8-be97-4462-aba2-d838bf052f8d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:24.886265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698364d8-be97-4462-aba2-d838bf052f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:24.886552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698364d8-be97-4462-aba2-d838bf052f8d admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:24.887778 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698364d8-be97-4462-aba2-d838bf052f8d admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:24.889904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698364d8-be97-4462-aba2-d838bf052f8d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:24.891582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 70/135] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:24 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:24.898144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f49e-5651-4c5f-9a80-6ca9b215273b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:24.908016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f49e-5651-4c5f-9a80-6ca9b215273b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:24.913624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55caebb-7934-4d4c-934c-07a563781c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:24.914280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55caebb-7934-4d4c-934c-07a563781c08 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:24.914604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55caebb-7934-4d4c-934c-07a563781c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:24.914885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55caebb-7934-4d4c-934c-07a563781c08 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:24.915729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55caebb-7934-4d4c-934c-07a563781c08 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6, user.id=a3eedbef815445d78eda15afd8ed2501) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:24.916042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55caebb-7934-4d4c-934c-07a563781c08 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:24.917961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55caebb-7934-4d4c-934c-07a563781c08 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:24.928859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 66/136] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:24 2021] GET /identity/v3/role_assignments?user.id=a3eedbef815445d78eda15afd8ed2501&scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:25.494015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce548be-4eb0-4374-9b33-692898e8710c None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:25.494406 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce548be-4eb0-4374-9b33-692898e8710c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:25.494600 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce548be-4eb0-4374-9b33-692898e8710c None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:25.496363 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 71/137] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:25.502680 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3dd12-44f0-4282-ae68-35532034da14 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:25.502979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3dd12-44f0-4282-ae68-35532034da14 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:25.503268 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3dd12-44f0-4282-ae68-35532034da14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:25.525982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-ebf3dd12-44f0-4282-ae68-35532034da14 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:25.527193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ebf3dd12-44f0-4282-ae68-35532034da14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:25.537508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 67/138] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:25.580384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce548be-4eb0-4374-9b33-692898e8710c None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:25.598511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce548be-4eb0-4374-9b33-692898e8710c None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:25.604634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d5114-31b6-41d6-8559-4329acab1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:25.605455 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d5114-31b6-41d6-8559-4329acab1f81 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:25.605743 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d5114-31b6-41d6-8559-4329acab1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:25.606021 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d5114-31b6-41d6-8559-4329acab1f81 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:25.625407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d5114-31b6-41d6-8559-4329acab1f81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:25.632855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-b30d5114-31b6-41d6-8559-4329acab1f81 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:25.634326 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 72/139] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:25.640763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3dd12-44f0-4282-ae68-35532034da14 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:25.653507 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3dd12-44f0-4282-ae68-35532034da14 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:25.661881 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3a6ae-92f0-41fc-8760-9d0af00ac4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:25.662586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3a6ae-92f0-41fc-8760-9d0af00ac4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:25.662846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3a6ae-92f0-41fc-8760-9d0af00ac4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:25.663131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3a6ae-92f0-41fc-8760-9d0af00ac4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:25.663898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3a6ae-92f0-41fc-8760-9d0af00ac4c4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:25.664210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3a6ae-92f0-41fc-8760-9d0af00ac4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:25.666438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3a6ae-92f0-41fc-8760-9d0af00ac4c4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:25.681593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 68/140] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:25.687209 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d5114-31b6-41d6-8559-4329acab1f81 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:25.701551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d5114-31b6-41d6-8559-4329acab1f81 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:25.713079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f5fc9-62ec-4b92-8813-e7bd11eb0e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:25.713991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f5fc9-62ec-4b92-8813-e7bd11eb0e6c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:25.714272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f5fc9-62ec-4b92-8813-e7bd11eb0e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:25.714562 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f5fc9-62ec-4b92-8813-e7bd11eb0e6c admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:25.721351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f5fc9-62ec-4b92-8813-e7bd11eb0e6c admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:25.723576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f5fc9-62ec-4b92-8813-e7bd11eb0e6c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:25.725563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 73/141] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:25 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:25.733018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3a6ae-92f0-41fc-8760-9d0af00ac4c4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:25.745785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3a6ae-92f0-41fc-8760-9d0af00ac4c4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:25.755044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48bd86-a81e-49d5-8d4d-597913e2b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:25.755693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48bd86-a81e-49d5-8d4d-597913e2b9bb admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:25.755986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48bd86-a81e-49d5-8d4d-597913e2b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:25.756268 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48bd86-a81e-49d5-8d4d-597913e2b9bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:25.768120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48bd86-a81e-49d5-8d4d-597913e2b9bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:25.769944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48bd86-a81e-49d5-8d4d-597913e2b9bb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:25.782215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 69/142] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:25.789331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f5fc9-62ec-4b92-8813-e7bd11eb0e6c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:25.806354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f5fc9-62ec-4b92-8813-e7bd11eb0e6c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:25.816564 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062d69c-1f01-48f6-901a-3059b5c5e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:25.817439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062d69c-1f01-48f6-901a-3059b5c5e66f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:25.817721 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062d69c-1f01-48f6-901a-3059b5c5e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:25.817999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062d69c-1f01-48f6-901a-3059b5c5e66f admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:25.821006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062d69c-1f01-48f6-901a-3059b5c5e66f admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:25.823088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062d69c-1f01-48f6-901a-3059b5c5e66f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:25.824838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 74/143] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:25 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:25.831757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48bd86-a81e-49d5-8d4d-597913e2b9bb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:25.845658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48bd86-a81e-49d5-8d4d-597913e2b9bb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:25.856327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78db7-71c1-452d-9aa5-8500a317cde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:25.857032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78db7-71c1-452d-9aa5-8500a317cde9 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:25.857309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78db7-71c1-452d-9aa5-8500a317cde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:25.857589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78db7-71c1-452d-9aa5-8500a317cde9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:25.858435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78db7-71c1-452d-9aa5-8500a317cde9 admin admin] RBAC: Adding query filter params (role.id=3df7162472e345bd91ce9469ee6fe3f5, scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6, user.id=6996fd7dbb564d26aa210e18c1319348) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:25.858746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78db7-71c1-452d-9aa5-8500a317cde9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:25.860659 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78db7-71c1-452d-9aa5-8500a317cde9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:25.873142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 70/144] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:25 2021] GET /identity/v3/role_assignments?user.id=6996fd7dbb564d26aa210e18c1319348&scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6&role.id=3df7162472e345bd91ce9469ee6fe3f5 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:26.185060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292ee1d-27d2-4b9c-b578-f25c1d5025aa None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.185422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292ee1d-27d2-4b9c-b578-f25c1d5025aa None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.185613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292ee1d-27d2-4b9c-b578-f25c1d5025aa None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.187388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 75/145] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:26.194083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360bbb0-9253-4066-9890-3a21c88f6dc8 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.194401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360bbb0-9253-4066-9890-3a21c88f6dc8 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.194706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360bbb0-9253-4066-9890-3a21c88f6dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.219328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-8360bbb0-9253-4066-9890-3a21c88f6dc8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:26.220618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8360bbb0-9253-4066-9890-3a21c88f6dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:26.232446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 71/146] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:26.277099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292ee1d-27d2-4b9c-b578-f25c1d5025aa None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.294283 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292ee1d-27d2-4b9c-b578-f25c1d5025aa None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.299029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647072c5-6969-472c-8cb4-a45e5656f896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.299918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647072c5-6969-472c-8cb4-a45e5656f896 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.300258 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647072c5-6969-472c-8cb4-a45e5656f896 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.300675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647072c5-6969-472c-8cb4-a45e5656f896 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.313633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647072c5-6969-472c-8cb4-a45e5656f896 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:26.320502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-647072c5-6969-472c-8cb4-a45e5656f896 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:26.322499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 76/147] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:26.329253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360bbb0-9253-4066-9890-3a21c88f6dc8 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.339316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360bbb0-9253-4066-9890-3a21c88f6dc8 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.346405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c470c8-088c-4835-ac89-8148d3a139ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.347176 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c470c8-088c-4835-ac89-8148d3a139ff admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.347430 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c470c8-088c-4835-ac89-8148d3a139ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.347710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c470c8-088c-4835-ac89-8148d3a139ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.348510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c470c8-088c-4835-ac89-8148d3a139ff admin admin] RBAC: Adding query filter params (name=member) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:26.348822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c470c8-088c-4835-ac89-8148d3a139ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.350469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c470c8-088c-4835-ac89-8148d3a139ff admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:26.365107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 72/148] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:26.370624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dafde3-d7a8-4da7-89f2-2dc4c7d3ec9f None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.370894 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dafde3-d7a8-4da7-89f2-2dc4c7d3ec9f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.371120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dafde3-d7a8-4da7-89f2-2dc4c7d3ec9f None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.373242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 77/149] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:26.374198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c470c8-088c-4835-ac89-8148d3a139ff admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.379135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319bac6-ff88-46c8-ba12-78c0ded59a66 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.379425 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319bac6-ff88-46c8-ba12-78c0ded59a66 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.379709 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319bac6-ff88-46c8-ba12-78c0ded59a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.407029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-1319bac6-ff88-46c8-ba12-78c0ded59a66 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:26.408256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1319bac6-ff88-46c8-ba12-78c0ded59a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:26.411422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c470c8-088c-4835-ac89-8148d3a139ff admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.425187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d1d16-1211-40db-afed-381070034474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.426215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d1d16-1211-40db-afed-381070034474 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.426506 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d1d16-1211-40db-afed-381070034474 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.426792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d1d16-1211-40db-afed-381070034474 admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.427130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 78/150] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:26.428269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d1d16-1211-40db-afed-381070034474 admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.430593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d1d16-1211-40db-afed-381070034474 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:26.432460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 73/151] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:26.439822 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319bac6-ff88-46c8-ba12-78c0ded59a66 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.450273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319bac6-ff88-46c8-ba12-78c0ded59a66 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.460768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270fc3-7569-460e-a396-12a0adbbb87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.461498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270fc3-7569-460e-a396-12a0adbbb87d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.462303 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270fc3-7569-460e-a396-12a0adbbb87d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.462587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270fc3-7569-460e-a396-12a0adbbb87d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.465362 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d1d16-1211-40db-afed-381070034474 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.477852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94270fc3-7569-460e-a396-12a0adbbb87d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.478148 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d1d16-1211-40db-afed-381070034474 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.479729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94270fc3-7569-460e-a396-12a0adbbb87d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:26.493197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd1020-6ce1-4ddc-9d0b-2954c4ed0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.494016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd1020-6ce1-4ddc-9d0b-2954c4ed0e6a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.494238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 79/152] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:26.494396 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd1020-6ce1-4ddc-9d0b-2954c4ed0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.494665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd1020-6ce1-4ddc-9d0b-2954c4ed0e6a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.502637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270fc3-7569-460e-a396-12a0adbbb87d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.513148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270fc3-7569-460e-a396-12a0adbbb87d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.517480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd1020-6ce1-4ddc-9d0b-2954c4ed0e6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:26.529097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ebf0f-eae5-4bd2-bf02-67fe0c59758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.529516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-14cd1020-6ce1-4ddc-9d0b-2954c4ed0e6a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:26.530067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ebf0f-eae5-4bd2-bf02-67fe0c59758b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.530280 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ebf0f-eae5-4bd2-bf02-67fe0c59758b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.530559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ebf0f-eae5-4bd2-bf02-67fe0c59758b admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.531039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 74/153] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:26.532612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ebf0f-eae5-4bd2-bf02-67fe0c59758b admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.534719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ebf0f-eae5-4bd2-bf02-67fe0c59758b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:26.537371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd1020-6ce1-4ddc-9d0b-2954c4ed0e6a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.538160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 80/154] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:26.545021 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ebf0f-eae5-4bd2-bf02-67fe0c59758b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.554151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd1020-6ce1-4ddc-9d0b-2954c4ed0e6a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.558822 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ebf0f-eae5-4bd2-bf02-67fe0c59758b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.565446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cec3fa-6e3c-45a1-8619-644e37f3d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.566383 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cec3fa-6e3c-45a1-8619-644e37f3d599 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.566675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cec3fa-6e3c-45a1-8619-644e37f3d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.566957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cec3fa-6e3c-45a1-8619-644e37f3d599 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.567822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cec3fa-6e3c-45a1-8619-644e37f3d599 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:26.568142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cec3fa-6e3c-45a1-8619-644e37f3d599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.569816 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cec3fa-6e3c-45a1-8619-644e37f3d599 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:26.572977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b0fb9-cfaa-40c5-9a5f-5f873a5dd635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.573662 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b0fb9-cfaa-40c5-9a5f-5f873a5dd635 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.573941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b0fb9-cfaa-40c5-9a5f-5f873a5dd635 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.574218 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b0fb9-cfaa-40c5-9a5f-5f873a5dd635 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.575069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b0fb9-cfaa-40c5-9a5f-5f873a5dd635 admin admin] RBAC: Adding query filter params (role.id=70600290909e4c808126b1efb2142b05, scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6, user.id=6996fd7dbb564d26aa210e18c1319348) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:26.575378 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b0fb9-cfaa-40c5-9a5f-5f873a5dd635 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.577788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b0fb9-cfaa-40c5-9a5f-5f873a5dd635 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:26.585186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 81/155] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/role_assignments?user.id=6996fd7dbb564d26aa210e18c1319348&scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6&role.id=70600290909e4c808126b1efb2142b05 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:26.588631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 75/156] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:26.594764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b0fb9-cfaa-40c5-9a5f-5f873a5dd635 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.605603 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b0fb9-cfaa-40c5-9a5f-5f873a5dd635 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.617047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b52f-9371-41c1-be0f-cf4e473a6839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.617956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b52f-9371-41c1-be0f-cf4e473a6839 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.618241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b52f-9371-41c1-be0f-cf4e473a6839 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.618517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b52f-9371-41c1-be0f-cf4e473a6839 admin admin] PATH_INFO: `/v3/users/4172444346f24a05896f00771c673d03` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.643907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b52f-9371-41c1-be0f-cf4e473a6839 admin admin] RBAC: Authorizing `identity:get_user(user_id=4172444346f24a05896f00771c673d03)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.646138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b52f-9371-41c1-be0f-cf4e473a6839 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:26.648385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 82/157] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/users/4172444346f24a05896f00771c673d03 => generated 283 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:26.654959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cec3fa-6e3c-45a1-8619-644e37f3d599 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.680731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cec3fa-6e3c-45a1-8619-644e37f3d599 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.686345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f422cca-6bca-48c8-89c6-d06a76806e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.687008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f422cca-6bca-48c8-89c6-d06a76806e0c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.687295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f422cca-6bca-48c8-89c6-d06a76806e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.687576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f422cca-6bca-48c8-89c6-d06a76806e0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.705502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f422cca-6bca-48c8-89c6-d06a76806e0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.707327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f422cca-6bca-48c8-89c6-d06a76806e0c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:26.723765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 76/158] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:26.730900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b52f-9371-41c1-be0f-cf4e473a6839 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.747366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b52f-9371-41c1-be0f-cf4e473a6839 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.765760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c5545-d61e-4033-a1ea-da5f8271b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.766642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c5545-d61e-4033-a1ea-da5f8271b189 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.766927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c5545-d61e-4033-a1ea-da5f8271b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.767236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c5545-d61e-4033-a1ea-da5f8271b189 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.773298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c5545-d61e-4033-a1ea-da5f8271b189 admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.775481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c5545-d61e-4033-a1ea-da5f8271b189 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:26.777709 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 83/159] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:26.784492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f422cca-6bca-48c8-89c6-d06a76806e0c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.795389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f422cca-6bca-48c8-89c6-d06a76806e0c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.807490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a682b-f417-4429-88c7-452b41700328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.808221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a682b-f417-4429-88c7-452b41700328 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.808538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a682b-f417-4429-88c7-452b41700328 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.808818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a682b-f417-4429-88c7-452b41700328 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.809664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a682b-f417-4429-88c7-452b41700328 admin admin] RBAC: Adding query filter params (role.id=70600290909e4c808126b1efb2142b05, scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8, user.id=4172444346f24a05896f00771c673d03) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:26.809977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a682b-f417-4429-88c7-452b41700328 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.811990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a682b-f417-4429-88c7-452b41700328 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:26.825605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 77/160] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:26 2021] GET /identity/v3/role_assignments?user.id=4172444346f24a05896f00771c673d03&scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8&role.id=70600290909e4c808126b1efb2142b05 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:27.133854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5fc2-5334-4b35-9397-e9c41657d848 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.134189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5fc2-5334-4b35-9397-e9c41657d848 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.134355 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5fc2-5334-4b35-9397-e9c41657d848 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.136394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 84/161] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:27.157147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165250d9-47bb-4aae-9fcc-4ffdf4714640 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.157451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165250d9-47bb-4aae-9fcc-4ffdf4714640 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.157694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165250d9-47bb-4aae-9fcc-4ffdf4714640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.181108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-165250d9-47bb-4aae-9fcc-4ffdf4714640 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:27.182324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-165250d9-47bb-4aae-9fcc-4ffdf4714640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:27.191984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 78/162] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:27.222039 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b5fc2-5334-4b35-9397-e9c41657d848 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.238292 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b5fc2-5334-4b35-9397-e9c41657d848 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.242828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81ae2e-e18e-4280-92ae-7f72b5d6aeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.243921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81ae2e-e18e-4280-92ae-7f72b5d6aeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.244206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81ae2e-e18e-4280-92ae-7f72b5d6aeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.244515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81ae2e-e18e-4280-92ae-7f72b5d6aeb4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.256446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81ae2e-e18e-4280-92ae-7f72b5d6aeb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:27.265491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-cf81ae2e-e18e-4280-92ae-7f72b5d6aeb4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:27.266748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 85/163] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:27.273272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165250d9-47bb-4aae-9fcc-4ffdf4714640 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.290212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165250d9-47bb-4aae-9fcc-4ffdf4714640 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.298855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514b4fc-3731-4f24-9503-33af5979cc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.299616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514b4fc-3731-4f24-9503-33af5979cc55 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.299906 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514b4fc-3731-4f24-9503-33af5979cc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.300184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514b4fc-3731-4f24-9503-33af5979cc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.301022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514b4fc-3731-4f24-9503-33af5979cc55 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:27.301334 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514b4fc-3731-4f24-9503-33af5979cc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.303079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514b4fc-3731-4f24-9503-33af5979cc55 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.318951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 79/164] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:27.326094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81ae2e-e18e-4280-92ae-7f72b5d6aeb4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.341725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81ae2e-e18e-4280-92ae-7f72b5d6aeb4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.351244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10f0c7-b633-47a7-be5f-9d3f9ae62f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.352483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f0c7-b633-47a7-be5f-9d3f9ae62f15 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.352959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f0c7-b633-47a7-be5f-9d3f9ae62f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.353413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f0c7-b633-47a7-be5f-9d3f9ae62f15 admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.354803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10f0c7-b633-47a7-be5f-9d3f9ae62f15 admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.357187 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10f0c7-b633-47a7-be5f-9d3f9ae62f15 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.359311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 86/165] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:27.365766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514b4fc-3731-4f24-9503-33af5979cc55 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.377950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514b4fc-3731-4f24-9503-33af5979cc55 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.382708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c2b93-85fc-421f-9378-ba75187314a6 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.383829 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c2b93-85fc-421f-9378-ba75187314a6 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.384375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c2b93-85fc-421f-9378-ba75187314a6 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.385602 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3a4ac-f54c-4d21-8c9e-ed4e9969dc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.386254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3a4ac-f54c-4d21-8c9e-ed4e9969dc45 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.386595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3a4ac-f54c-4d21-8c9e-ed4e9969dc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.386870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3a4ac-f54c-4d21-8c9e-ed4e9969dc45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.387502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 87/166] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:27.393991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897652-9cf2-4209-8f90-6ae8ac2191ae None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.394275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897652-9cf2-4209-8f90-6ae8ac2191ae None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.394550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897652-9cf2-4209-8f90-6ae8ac2191ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.402646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3a4ac-f54c-4d21-8c9e-ed4e9969dc45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.404462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3a4ac-f54c-4d21-8c9e-ed4e9969dc45 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.425806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 80/167] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:27.429426 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-28897652-9cf2-4209-8f90-6ae8ac2191ae None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:27.431200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-28897652-9cf2-4209-8f90-6ae8ac2191ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:27.434141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3a4ac-f54c-4d21-8c9e-ed4e9969dc45 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.442140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 88/168] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:27.443667 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3a4ac-f54c-4d21-8c9e-ed4e9969dc45 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.449022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e2e42-18e4-4e1b-9618-a4814ce82c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.449937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e2e42-18e4-4e1b-9618-a4814ce82c71 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.450273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e2e42-18e4-4e1b-9618-a4814ce82c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.450548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e2e42-18e4-4e1b-9618-a4814ce82c71 admin admin] PATH_INFO: `/v3/projects/9b9245eaa111477eacd21e257b36b348` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.451803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e2e42-18e4-4e1b-9618-a4814ce82c71 admin admin] RBAC: Authorizing `identity:get_project(project_id=9b9245eaa111477eacd21e257b36b348)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.454120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e2e42-18e4-4e1b-9618-a4814ce82c71 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.456027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 81/169] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/projects/9b9245eaa111477eacd21e257b36b348 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:27.462772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28897652-9cf2-4209-8f90-6ae8ac2191ae None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.467400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e2e42-18e4-4e1b-9618-a4814ce82c71 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.473414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28897652-9cf2-4209-8f90-6ae8ac2191ae None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.478308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e2e42-18e4-4e1b-9618-a4814ce82c71 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.486078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833e9df-1010-4126-90bf-dd561c833c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.486959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395d10c-211a-4623-b134-cacab4eed4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.488145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833e9df-1010-4126-90bf-dd561c833c8c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.488446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833e9df-1010-4126-90bf-dd561c833c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.488720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833e9df-1010-4126-90bf-dd561c833c8c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.489121 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d10c-211a-4623-b134-cacab4eed4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.489401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d10c-211a-4623-b134-cacab4eed4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.489670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d10c-211a-4623-b134-cacab4eed4e8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.490913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833e9df-1010-4126-90bf-dd561c833c8c admin admin] RBAC: Adding query filter params (role.id=70600290909e4c808126b1efb2142b05, scope.project.id=9b9245eaa111477eacd21e257b36b348, user.id=6996fd7dbb564d26aa210e18c1319348) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:27.491228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833e9df-1010-4126-90bf-dd561c833c8c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.496169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833e9df-1010-4126-90bf-dd561c833c8c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.509835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 89/170] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/role_assignments?user.id=6996fd7dbb564d26aa210e18c1319348&scope.project.id=9b9245eaa111477eacd21e257b36b348&role.id=70600290909e4c808126b1efb2142b05 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:27.510831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395d10c-211a-4623-b134-cacab4eed4e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:27.517991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-3395d10c-211a-4623-b134-cacab4eed4e8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:27.519309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 82/171] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:27.529553 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833e9df-1010-4126-90bf-dd561c833c8c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.543232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833e9df-1010-4126-90bf-dd561c833c8c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.552952 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c06a06-3899-441e-8892-90ff880ae493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.553725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c06a06-3899-441e-8892-90ff880ae493 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.554015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c06a06-3899-441e-8892-90ff880ae493 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.554291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c06a06-3899-441e-8892-90ff880ae493 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.555197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c06a06-3899-441e-8892-90ff880ae493 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:27.555531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c06a06-3899-441e-8892-90ff880ae493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.557281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c06a06-3899-441e-8892-90ff880ae493 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.573022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 90/172] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:27.579618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395d10c-211a-4623-b134-cacab4eed4e8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.595264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395d10c-211a-4623-b134-cacab4eed4e8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.599947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d044a9-ec73-44e9-a9dc-e36774352085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.600887 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d044a9-ec73-44e9-a9dc-e36774352085 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.601173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d044a9-ec73-44e9-a9dc-e36774352085 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.601448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d044a9-ec73-44e9-a9dc-e36774352085 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.603332 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d044a9-ec73-44e9-a9dc-e36774352085 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.605393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d044a9-ec73-44e9-a9dc-e36774352085 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.607130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 83/173] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:27.614028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c06a06-3899-441e-8892-90ff880ae493 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.625975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c06a06-3899-441e-8892-90ff880ae493 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.632570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e514ab6-b65f-4eed-a954-1bcb872a7663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.633351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514ab6-b65f-4eed-a954-1bcb872a7663 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.633686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514ab6-b65f-4eed-a954-1bcb872a7663 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.634015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514ab6-b65f-4eed-a954-1bcb872a7663 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.647225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e514ab6-b65f-4eed-a954-1bcb872a7663 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.649697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e514ab6-b65f-4eed-a954-1bcb872a7663 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.661990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6aeac3-5646-43a9-a44f-9776ff7c34a5 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.662295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6aeac3-5646-43a9-a44f-9776ff7c34a5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.662534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6aeac3-5646-43a9-a44f-9776ff7c34a5 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.664598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 84/174] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:24:27.671140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 91/175] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:27.676738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3e9f5-7c74-44c5-88c2-82461c9c96f3 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.677014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3e9f5-7c74-44c5-88c2-82461c9c96f3 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.677284 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3e9f5-7c74-44c5-88c2-82461c9c96f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.683314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e514ab6-b65f-4eed-a954-1bcb872a7663 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.703688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e514ab6-b65f-4eed-a954-1bcb872a7663 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.712863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-38b3e9f5-7c74-44c5-88c2-82461c9c96f3 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:27.715231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed0f1f-d863-45d6-88a1-2788fb7a3c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.716415 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed0f1f-d863-45d6-88a1-2788fb7a3c4c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.716920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed0f1f-d863-45d6-88a1-2788fb7a3c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.717418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed0f1f-d863-45d6-88a1-2788fb7a3c4c admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.719654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-38b3e9f5-7c74-44c5-88c2-82461c9c96f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:27.720691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed0f1f-d863-45d6-88a1-2788fb7a3c4c admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.723437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed0f1f-d863-45d6-88a1-2788fb7a3c4c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.725835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 92/176] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:27.728419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79019cc-8275-4730-a805-88732c3cde3a None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.728419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79019cc-8275-4730-a805-88732c3cde3a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.728841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79019cc-8275-4730-a805-88732c3cde3a None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.733038 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 93/177] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:27 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:27.737569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79019cc-8275-4730-a805-88732c3cde3a None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.740027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 85/178] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:27.743521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86013b-b263-4e03-b2fc-0ed018ca1a47 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.743746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86013b-b263-4e03-b2fc-0ed018ca1a47 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.744083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86013b-b263-4e03-b2fc-0ed018ca1a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.764165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79019cc-8275-4730-a805-88732c3cde3a None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.776375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1098-6da2-4405-be71-b342cd5fefa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.776375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1098-6da2-4405-be71-b342cd5fefa3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.776375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1098-6da2-4405-be71-b342cd5fefa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.776675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1098-6da2-4405-be71-b342cd5fefa3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.777686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a1098-6da2-4405-be71-b342cd5fefa3 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8, user.id=a3eedbef815445d78eda15afd8ed2501) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:27.778102 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a1098-6da2-4405-be71-b342cd5fefa3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.778973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-5a86013b-b263-4e03-b2fc-0ed018ca1a47 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:27.780121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a1098-6da2-4405-be71-b342cd5fefa3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.780221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5a86013b-b263-4e03-b2fc-0ed018ca1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:27.788204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 94/179] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/role_assignments?user.id=a3eedbef815445d78eda15afd8ed2501&scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:27.789122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1098-6da2-4405-be71-b342cd5fefa3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.795179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 86/180] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:27.807978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1098-6da2-4405-be71-b342cd5fefa3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.820235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5c255-fe7b-46ca-a0d1-625abb96cbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.821480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5c255-fe7b-46ca-a0d1-625abb96cbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.821930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5c255-fe7b-46ca-a0d1-625abb96cbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.822377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5c255-fe7b-46ca-a0d1-625abb96cbe9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.825315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5c255-fe7b-46ca-a0d1-625abb96cbe9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.827084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5c255-fe7b-46ca-a0d1-625abb96cbe9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.829067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 95/181] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:27.829315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86013b-b263-4e03-b2fc-0ed018ca1a47 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.839558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5c255-fe7b-46ca-a0d1-625abb96cbe9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.843594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86013b-b263-4e03-b2fc-0ed018ca1a47 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.853632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db68fe-aa74-401a-8280-a5966d844d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.853632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db68fe-aa74-401a-8280-a5966d844d5f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.853923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db68fe-aa74-401a-8280-a5966d844d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.854360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db68fe-aa74-401a-8280-a5966d844d5f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.858690 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5c255-fe7b-46ca-a0d1-625abb96cbe9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.868875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84261f-2220-491c-becf-dcb76e6bf71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.869559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84261f-2220-491c-becf-dcb76e6bf71a admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.869839 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84261f-2220-491c-becf-dcb76e6bf71a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.870112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84261f-2220-491c-becf-dcb76e6bf71a admin admin] PATH_INFO: `/v3/groups` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.870826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84261f-2220-491c-becf-dcb76e6bf71a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.872071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-cb84261f-2220-491c-becf-dcb76e6bf71a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:27.872071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:27.872071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:27.873099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db68fe-aa74-401a-8280-a5966d844d5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:27.873427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84261f-2220-491c-becf-dcb76e6bf71a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.881999 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-55db68fe-aa74-401a-8280-a5966d844d5f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:27.883640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 87/182] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:27.890553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db68fe-aa74-401a-8280-a5966d844d5f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.904277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db68fe-aa74-401a-8280-a5966d844d5f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.907984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63722490-960f-4803-b1fb-4d9b3419cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.908783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63722490-960f-4803-b1fb-4d9b3419cbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.909002 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63722490-960f-4803-b1fb-4d9b3419cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.909327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63722490-960f-4803-b1fb-4d9b3419cbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.910349 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63722490-960f-4803-b1fb-4d9b3419cbe2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:27.910655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63722490-960f-4803-b1fb-4d9b3419cbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.912371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63722490-960f-4803-b1fb-4d9b3419cbe2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.923661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 88/183] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:27.930065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63722490-960f-4803-b1fb-4d9b3419cbe2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.940972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63722490-960f-4803-b1fb-4d9b3419cbe2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.948393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c8e05-3e30-4713-b3d6-65c8c63a6177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.948393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c8e05-3e30-4713-b3d6-65c8c63a6177 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.948393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c8e05-3e30-4713-b3d6-65c8c63a6177 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.948393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c8e05-3e30-4713-b3d6-65c8c63a6177 admin admin] PATH_INFO: `/v3/users/4172444346f24a05896f00771c673d03` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.950991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c8e05-3e30-4713-b3d6-65c8c63a6177 admin admin] RBAC: Authorizing `identity:get_user(user_id=4172444346f24a05896f00771c673d03)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.951120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 96/184] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Aug 27 04:24:27 2021] POST /identity/v3/groups => generated 229 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:27.952045 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c8e05-3e30-4713-b3d6-65c8c63a6177 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.954418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 89/185] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/users/4172444346f24a05896f00771c673d03 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:27.961064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84261f-2220-491c-becf-dcb76e6bf71a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.983064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84261f-2220-491c-becf-dcb76e6bf71a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.999143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8054b0-396b-458d-97c6-1ec70d70085e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.999803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8054b0-396b-458d-97c6-1ec70d70085e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:28.000084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8054b0-396b-458d-97c6-1ec70d70085e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:28.000371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8054b0-396b-458d-97c6-1ec70d70085e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:28.016331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8054b0-396b-458d-97c6-1ec70d70085e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:28.018593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8054b0-396b-458d-97c6-1ec70d70085e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:28.031553 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 97/186] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:28.038998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c8e05-3e30-4713-b3d6-65c8c63a6177 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:28.059021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c8e05-3e30-4713-b3d6-65c8c63a6177 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:28.064341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d205131-bc67-40b4-878f-5a854ceb1402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:28.065751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d205131-bc67-40b4-878f-5a854ceb1402 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:28.066259 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d205131-bc67-40b4-878f-5a854ceb1402 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:28.066794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d205131-bc67-40b4-878f-5a854ceb1402 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:28.068521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d205131-bc67-40b4-878f-5a854ceb1402 admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:28.071128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d205131-bc67-40b4-878f-5a854ceb1402 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:28.073669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 90/187] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:28 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:28.081572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8054b0-396b-458d-97c6-1ec70d70085e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:28.091483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8054b0-396b-458d-97c6-1ec70d70085e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:28.096403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866640a-37a8-49a3-9850-694d2d3606bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:28.097143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866640a-37a8-49a3-9850-694d2d3606bb admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:28.097423 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866640a-37a8-49a3-9850-694d2d3606bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:28.097694 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866640a-37a8-49a3-9850-694d2d3606bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:28.098592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866640a-37a8-49a3-9850-694d2d3606bb admin admin] RBAC: Adding query filter params (role.id=3df7162472e345bd91ce9469ee6fe3f5, scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8, user.id=4172444346f24a05896f00771c673d03) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:28.098895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866640a-37a8-49a3-9850-694d2d3606bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:28.100943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866640a-37a8-49a3-9850-694d2d3606bb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:28.108197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 98/188] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:28 2021] GET /identity/v3/role_assignments?user.id=4172444346f24a05896f00771c673d03&scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8&role.id=3df7162472e345bd91ce9469ee6fe3f5 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:29.317073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79e361-72a1-4b0e-b533-e778adca142a None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:29.317784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79e361-72a1-4b0e-b533-e778adca142a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:29.317784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79e361-72a1-4b0e-b533-e778adca142a None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:29.319543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 91/189] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:29.326581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45526-08c4-4769-a51a-0159dd4eb569 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:29.327435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45526-08c4-4769-a51a-0159dd4eb569 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:29.327933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45526-08c4-4769-a51a-0159dd4eb569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:29.346286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-77a45526-08c4-4769-a51a-0159dd4eb569 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:29.347795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-77a45526-08c4-4769-a51a-0159dd4eb569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:29.356575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 99/190] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:29.380179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79e361-72a1-4b0e-b533-e778adca142a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:29.393809 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79e361-72a1-4b0e-b533-e778adca142a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:29.398868 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185432c4-0b20-45bb-b129-f9bcc966224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:29.400428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185432c4-0b20-45bb-b129-f9bcc966224c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:29.400914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185432c4-0b20-45bb-b129-f9bcc966224c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:29.401384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185432c4-0b20-45bb-b129-f9bcc966224c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:29.412689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185432c4-0b20-45bb-b129-f9bcc966224c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:29.422633 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-185432c4-0b20-45bb-b129-f9bcc966224c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:29.424145 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 92/191] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:29.431320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45526-08c4-4769-a51a-0159dd4eb569 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:29.440771 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45526-08c4-4769-a51a-0159dd4eb569 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:29.445557 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914331ea-631c-4fb2-b8ee-779461648ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:29.446984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914331ea-631c-4fb2-b8ee-779461648ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:29.447464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914331ea-631c-4fb2-b8ee-779461648ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:29.447933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914331ea-631c-4fb2-b8ee-779461648ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:29.448907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914331ea-631c-4fb2-b8ee-779461648ac5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:29.449505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914331ea-631c-4fb2-b8ee-779461648ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:29.451299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914331ea-631c-4fb2-b8ee-779461648ac5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:29.460219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 100/192] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:29.467248 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185432c4-0b20-45bb-b129-f9bcc966224c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:29.478287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185432c4-0b20-45bb-b129-f9bcc966224c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:29.483022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99705ce7-fedf-430b-881d-d305bed52d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:29.484090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99705ce7-fedf-430b-881d-d305bed52d63 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:29.484604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99705ce7-fedf-430b-881d-d305bed52d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:29.485090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99705ce7-fedf-430b-881d-d305bed52d63 admin admin] PATH_INFO: `/v3/users/4172444346f24a05896f00771c673d03` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:29.486516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99705ce7-fedf-430b-881d-d305bed52d63 admin admin] RBAC: Authorizing `identity:get_user(user_id=4172444346f24a05896f00771c673d03)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:29.488909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99705ce7-fedf-430b-881d-d305bed52d63 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:29.490698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 93/193] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:29 2021] GET /identity/v3/users/4172444346f24a05896f00771c673d03 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:29.498395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914331ea-631c-4fb2-b8ee-779461648ac5 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:29.508952 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914331ea-631c-4fb2-b8ee-779461648ac5 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:29.513643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819ec2a-072d-404f-b31f-fa67019b6307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:29.514733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819ec2a-072d-404f-b31f-fa67019b6307 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:29.515225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819ec2a-072d-404f-b31f-fa67019b6307 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:29.515695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819ec2a-072d-404f-b31f-fa67019b6307 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:29.517104 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819ec2a-072d-404f-b31f-fa67019b6307 admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:29.519483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819ec2a-072d-404f-b31f-fa67019b6307 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:29.521408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 101/194] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:29 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:29.528294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99705ce7-fedf-430b-881d-d305bed52d63 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:29.538654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99705ce7-fedf-430b-881d-d305bed52d63 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:29.543604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6c303-1dfb-436a-bab5-cae46fad6321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:29.544894 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6c303-1dfb-436a-bab5-cae46fad6321 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:29.551038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6c303-1dfb-436a-bab5-cae46fad6321 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:29.551038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6c303-1dfb-436a-bab5-cae46fad6321 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8/users/4172444346f24a05896f00771c673d03/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:29.551038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6c303-1dfb-436a-bab5-cae46fad6321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a76e9656c64e7ea5e88bdd2440c8d8, user_id=4172444346f24a05896f00771c673d03, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:29.551038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6c303-1dfb-436a-bab5-cae46fad6321 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:29.646433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 94/195] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:29 2021] PUT /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8/users/4172444346f24a05896f00771c673d03/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:29.995274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9737f-424d-4674-9248-c2e5f1b4b412 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:29.995607 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9737f-424d-4674-9248-c2e5f1b4b412 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:29.995777 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9737f-424d-4674-9248-c2e5f1b4b412 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:29.997905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 102/196] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:30.004135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820810f-5649-436d-91fd-6e4ca75582ed None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.004461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820810f-5649-436d-91fd-6e4ca75582ed None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.004741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820810f-5649-436d-91fd-6e4ca75582ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.023303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3820810f-5649-436d-91fd-6e4ca75582ed None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:30.024586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3820810f-5649-436d-91fd-6e4ca75582ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:30.095347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 95/197] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:30.120599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9737f-424d-4674-9248-c2e5f1b4b412 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.132856 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9737f-424d-4674-9248-c2e5f1b4b412 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.137309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffd3fa-affa-4f82-a063-0ef9677600be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.138095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffd3fa-affa-4f82-a063-0ef9677600be admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.138375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffd3fa-affa-4f82-a063-0ef9677600be admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.138646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffd3fa-affa-4f82-a063-0ef9677600be admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.151836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffd3fa-affa-4f82-a063-0ef9677600be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:30.158667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-86ffd3fa-affa-4f82-a063-0ef9677600be admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:30.164966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 103/198] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:30.167230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820810f-5649-436d-91fd-6e4ca75582ed None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.177061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820810f-5649-436d-91fd-6e4ca75582ed None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.182288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617b2a1-0368-45fa-8c68-a8e02d5b453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.183031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617b2a1-0368-45fa-8c68-a8e02d5b453a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.183395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617b2a1-0368-45fa-8c68-a8e02d5b453a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.183751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617b2a1-0368-45fa-8c68-a8e02d5b453a admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.184607 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617b2a1-0368-45fa-8c68-a8e02d5b453a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:30.185004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617b2a1-0368-45fa-8c68-a8e02d5b453a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.186711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617b2a1-0368-45fa-8c68-a8e02d5b453a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.195554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 96/199] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:30.201925 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffd3fa-affa-4f82-a063-0ef9677600be admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.212776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffd3fa-affa-4f82-a063-0ef9677600be admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.217265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facb9b0-2bb7-4854-81a9-ffd882778986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.218132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb9b0-2bb7-4854-81a9-ffd882778986 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.218420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb9b0-2bb7-4854-81a9-ffd882778986 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.218698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb9b0-2bb7-4854-81a9-ffd882778986 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.220090 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facb9b0-2bb7-4854-81a9-ffd882778986 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.221960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facb9b0-2bb7-4854-81a9-ffd882778986 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.223635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 104/200] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:30.230779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617b2a1-0368-45fa-8c68-a8e02d5b453a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.241998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617b2a1-0368-45fa-8c68-a8e02d5b453a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.247572 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cd5f0-2c9b-48cf-af9d-109affe0e1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.248605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd5f0-2c9b-48cf-af9d-109affe0e1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.248898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd5f0-2c9b-48cf-af9d-109affe0e1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.249182 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd5f0-2c9b-48cf-af9d-109affe0e1e1 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.250660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cd5f0-2c9b-48cf-af9d-109affe0e1e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.252930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cd5f0-2c9b-48cf-af9d-109affe0e1e1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.254830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 97/201] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:30.264975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facb9b0-2bb7-4854-81a9-ffd882778986 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.275493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facb9b0-2bb7-4854-81a9-ffd882778986 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.280601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec66659-ca18-488d-8961-7451ee2c319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.281541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec66659-ca18-488d-8961-7451ee2c319e admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.281833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec66659-ca18-488d-8961-7451ee2c319e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.282169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec66659-ca18-488d-8961-7451ee2c319e admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8/users/a3eedbef815445d78eda15afd8ed2501/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.284239 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec66659-ca18-488d-8961-7451ee2c319e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a76e9656c64e7ea5e88bdd2440c8d8, user_id=a3eedbef815445d78eda15afd8ed2501, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.287108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec66659-ca18-488d-8961-7451ee2c319e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.317311 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cf101-e3eb-4a89-8374-b73b3db14d8c None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.317839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cf101-e3eb-4a89-8374-b73b3db14d8c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.317839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cf101-e3eb-4a89-8374-b73b3db14d8c None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.319669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 98/202] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:30.320830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ded26-a694-458b-8f21-b45c5131594e None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.321274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ded26-a694-458b-8f21-b45c5131594e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.321554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ded26-a694-458b-8f21-b45c5131594e None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.323151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 99/203] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:30.325327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69e8e-ad11-4214-92fc-26eba837955c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.325614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69e8e-ad11-4214-92fc-26eba837955c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.325891 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69e8e-ad11-4214-92fc-26eba837955c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.343642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-cdc69e8e-ad11-4214-92fc-26eba837955c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:30.344860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-cdc69e8e-ad11-4214-92fc-26eba837955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:30.352989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 100/204] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:30.354188 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079ea0d-ae8e-4cc9-883c-d5bc0e215455 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.354510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079ea0d-ae8e-4cc9-883c-d5bc0e215455 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.354781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079ea0d-ae8e-4cc9-883c-d5bc0e215455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.369084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 105/205] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:30 2021] PUT /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8/users/a3eedbef815445d78eda15afd8ed2501/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:30.379065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec66659-ca18-488d-8961-7451ee2c319e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.380470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-4079ea0d-ae8e-4cc9-883c-d5bc0e215455 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:30.381803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4079ea0d-ae8e-4cc9-883c-d5bc0e215455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:30.448993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec66659-ca18-488d-8961-7451ee2c319e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.459338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c0f72-397f-45cf-b685-9a68e5570a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.461810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c0f72-397f-45cf-b685-9a68e5570a55 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.462704 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c0f72-397f-45cf-b685-9a68e5570a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.463342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c0f72-397f-45cf-b685-9a68e5570a55 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.466028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c0f72-397f-45cf-b685-9a68e5570a55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.468776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c0f72-397f-45cf-b685-9a68e5570a55 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.468926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 101/206] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:30.478256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 106/207] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:30.479460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079ea0d-ae8e-4cc9-883c-d5bc0e215455 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.488908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c0f72-397f-45cf-b685-9a68e5570a55 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.494898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079ea0d-ae8e-4cc9-883c-d5bc0e215455 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.499882 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fbfbd-a7bc-4af4-9b23-4d4771f6ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.500514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fbfbd-a7bc-4af4-9b23-4d4771f6ef4b admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.500798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fbfbd-a7bc-4af4-9b23-4d4771f6ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.501108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fbfbd-a7bc-4af4-9b23-4d4771f6ef4b admin admin] PATH_INFO: `/v3/groups` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.501575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c0f72-397f-45cf-b685-9a68e5570a55 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.501769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fbfbd-a7bc-4af4-9b23-4d4771f6ef4b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.502929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-d91fbfbd-a7bc-4af4-9b23-4d4771f6ef4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:30.502929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:30.502929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:30.504428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fbfbd-a7bc-4af4-9b23-4d4771f6ef4b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.507484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b4df0-6eb3-467f-973a-86b9ec2f0163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.508786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b4df0-6eb3-467f-973a-86b9ec2f0163 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.509309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b4df0-6eb3-467f-973a-86b9ec2f0163 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.509779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b4df0-6eb3-467f-973a-86b9ec2f0163 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.523044 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b4df0-6eb3-467f-973a-86b9ec2f0163 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:30.534810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-d44b4df0-6eb3-467f-973a-86b9ec2f0163 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:30.536438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 107/208] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:30.545088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b4df0-6eb3-467f-973a-86b9ec2f0163 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.556491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b4df0-6eb3-467f-973a-86b9ec2f0163 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.561601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1cae4-79cf-4054-b3ba-f925d1cbb2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.562320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cae4-79cf-4054-b3ba-f925d1cbb2bd admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.562602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cae4-79cf-4054-b3ba-f925d1cbb2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.562878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cae4-79cf-4054-b3ba-f925d1cbb2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.563632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1cae4-79cf-4054-b3ba-f925d1cbb2bd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:30.563986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1cae4-79cf-4054-b3ba-f925d1cbb2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.565649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1cae4-79cf-4054-b3ba-f925d1cbb2bd admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.576053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 108/209] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:30.582141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1cae4-79cf-4054-b3ba-f925d1cbb2bd admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.593146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1cae4-79cf-4054-b3ba-f925d1cbb2bd admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.597181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771c11a-5f3b-4c61-a754-06c5ead91cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.598045 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771c11a-5f3b-4c61-a754-06c5ead91cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.598355 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771c11a-5f3b-4c61-a754-06c5ead91cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.598629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771c11a-5f3b-4c61-a754-06c5ead91cd3 admin admin] PATH_INFO: `/v3/users/4172444346f24a05896f00771c673d03` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.599820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771c11a-5f3b-4c61-a754-06c5ead91cd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=4172444346f24a05896f00771c673d03)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.602784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771c11a-5f3b-4c61-a754-06c5ead91cd3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.604437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 109/210] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/users/4172444346f24a05896f00771c673d03 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:30.610843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771c11a-5f3b-4c61-a754-06c5ead91cd3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.614708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 102/211] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Aug 27 04:24:30 2021] POST /identity/v3/groups => generated 226 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:24:30.620852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771c11a-5f3b-4c61-a754-06c5ead91cd3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.636226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538b795-b46f-4209-acfd-abc0e3908cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.637142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b795-b46f-4209-acfd-abc0e3908cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.637421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b795-b46f-4209-acfd-abc0e3908cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.637695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b795-b46f-4209-acfd-abc0e3908cc8 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.639264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538b795-b46f-4209-acfd-abc0e3908cc8 admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.641645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538b795-b46f-4209-acfd-abc0e3908cc8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.648526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 110/212] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:30.651815 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fbfbd-a7bc-4af4-9b23-4d4771f6ef4b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.662879 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fbfbd-a7bc-4af4-9b23-4d4771f6ef4b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.668952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eda61b-7c30-4836-9392-012237e07479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.670027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eda61b-7c30-4836-9392-012237e07479 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.670312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eda61b-7c30-4836-9392-012237e07479 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.670591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eda61b-7c30-4836-9392-012237e07479 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8/users/4172444346f24a05896f00771c673d03/roles/3df7162472e345bd91ce9469ee6fe3f5` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.673504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eda61b-7c30-4836-9392-012237e07479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a76e9656c64e7ea5e88bdd2440c8d8, user_id=4172444346f24a05896f00771c673d03, role_id=3df7162472e345bd91ce9469ee6fe3f5)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.676868 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eda61b-7c30-4836-9392-012237e07479 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.783566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 103/213] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:30 2021] PUT /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8/users/4172444346f24a05896f00771c673d03/roles/3df7162472e345bd91ce9469ee6fe3f5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:24:31.919771 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defdb9c-277e-4762-b20f-a49c3392626a None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:31.920469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defdb9c-277e-4762-b20f-a49c3392626a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:31.920469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defdb9c-277e-4762-b20f-a49c3392626a None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:31.922413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 111/214] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:31.928611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80163c-bad3-48ce-bfb0-f3b843051ca5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:31.929143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80163c-bad3-48ce-bfb0-f3b843051ca5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:31.929143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80163c-bad3-48ce-bfb0-f3b843051ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:31.966596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7d80163c-bad3-48ce-bfb0-f3b843051ca5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:31.967732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7d80163c-bad3-48ce-bfb0-f3b843051ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:32.038947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 104/215] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:32.067098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defdb9c-277e-4762-b20f-a49c3392626a None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:32.082807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defdb9c-277e-4762-b20f-a49c3392626a None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:32.088271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab7e93-c8db-45cd-a977-298e8c0eca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:32.089107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7e93-c8db-45cd-a977-298e8c0eca75 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:32.089398 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7e93-c8db-45cd-a977-298e8c0eca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:32.089668 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7e93-c8db-45cd-a977-298e8c0eca75 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:32.101846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab7e93-c8db-45cd-a977-298e8c0eca75 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:32.109323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-cbab7e93-c8db-45cd-a977-298e8c0eca75 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:32.110921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 112/216] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:32.117362 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80163c-bad3-48ce-bfb0-f3b843051ca5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:32.129635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80163c-bad3-48ce-bfb0-f3b843051ca5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:32.134432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d5cb3-9031-448e-8ef3-2b37de7117ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:32.135120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d5cb3-9031-448e-8ef3-2b37de7117ac admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:32.135432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d5cb3-9031-448e-8ef3-2b37de7117ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:32.135713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d5cb3-9031-448e-8ef3-2b37de7117ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:32.136516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d5cb3-9031-448e-8ef3-2b37de7117ac admin admin] RBAC: Adding query filter params (name=member) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:32.136831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d5cb3-9031-448e-8ef3-2b37de7117ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:32.138465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d5cb3-9031-448e-8ef3-2b37de7117ac admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:32.153062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 105/217] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:32.159640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab7e93-c8db-45cd-a977-298e8c0eca75 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:32.174657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab7e93-c8db-45cd-a977-298e8c0eca75 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:32.180276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761afc0-3309-4482-93d8-ad0c9089a5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:32.181178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761afc0-3309-4482-93d8-ad0c9089a5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:32.181458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761afc0-3309-4482-93d8-ad0c9089a5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:32.181726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761afc0-3309-4482-93d8-ad0c9089a5b3 admin admin] PATH_INFO: `/v3/users/4172444346f24a05896f00771c673d03` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:32.182932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761afc0-3309-4482-93d8-ad0c9089a5b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=4172444346f24a05896f00771c673d03)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:32.185224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761afc0-3309-4482-93d8-ad0c9089a5b3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:32.186868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 113/218] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:32 2021] GET /identity/v3/users/4172444346f24a05896f00771c673d03 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:32.193246 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d5cb3-9031-448e-8ef3-2b37de7117ac admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:32.204501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d5cb3-9031-448e-8ef3-2b37de7117ac admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:32.209394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e290ea6-8b95-4098-85a0-71e0af88144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:32.210036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e290ea6-8b95-4098-85a0-71e0af88144e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:32.210318 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e290ea6-8b95-4098-85a0-71e0af88144e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:32.210595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e290ea6-8b95-4098-85a0-71e0af88144e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:32.224544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e290ea6-8b95-4098-85a0-71e0af88144e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:32.226255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e290ea6-8b95-4098-85a0-71e0af88144e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:32.242063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 106/219] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:32.248999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761afc0-3309-4482-93d8-ad0c9089a5b3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:32.261520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761afc0-3309-4482-93d8-ad0c9089a5b3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:32.266242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8f482-e61b-40c6-b38c-80c39f4a65a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:32.267119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8f482-e61b-40c6-b38c-80c39f4a65a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:32.274515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8f482-e61b-40c6-b38c-80c39f4a65a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:32.274881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8f482-e61b-40c6-b38c-80c39f4a65a8 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:32.276412 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8f482-e61b-40c6-b38c-80c39f4a65a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:32.278493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8f482-e61b-40c6-b38c-80c39f4a65a8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:32.280227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 114/220] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:32 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:32.286921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e290ea6-8b95-4098-85a0-71e0af88144e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:32.297816 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e290ea6-8b95-4098-85a0-71e0af88144e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:32.302617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe78eb8-7b18-4c57-ab53-a55b269093ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:32.303300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78eb8-7b18-4c57-ab53-a55b269093ee admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:32.303586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78eb8-7b18-4c57-ab53-a55b269093ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:32.303868 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78eb8-7b18-4c57-ab53-a55b269093ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:32.304803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe78eb8-7b18-4c57-ab53-a55b269093ee admin admin] RBAC: Adding query filter params (role.id=70600290909e4c808126b1efb2142b05, scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8, user.id=4172444346f24a05896f00771c673d03) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:32.305161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe78eb8-7b18-4c57-ab53-a55b269093ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:32.307243 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe78eb8-7b18-4c57-ab53-a55b269093ee admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:32.317563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 107/221] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:32 2021] GET /identity/v3/role_assignments?user.id=4172444346f24a05896f00771c673d03&scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8&role.id=70600290909e4c808126b1efb2142b05 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:33.157436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950c06-4f04-4335-a6ed-505173bc498e None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.158136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950c06-4f04-4335-a6ed-505173bc498e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.158136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950c06-4f04-4335-a6ed-505173bc498e None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.160049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 115/222] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:33.166544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cb72-19fa-4df0-961c-6ef5498c495a None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.167107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cb72-19fa-4df0-961c-6ef5498c495a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.167107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cb72-19fa-4df0-961c-6ef5498c495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.197388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-74f3cb72-19fa-4df0-961c-6ef5498c495a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:33.198603 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-74f3cb72-19fa-4df0-961c-6ef5498c495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:33.210619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 108/223] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:33.256031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27950c06-4f04-4335-a6ed-505173bc498e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:33.273374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27950c06-4f04-4335-a6ed-505173bc498e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:33.285813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd3bd6-6a51-4234-a1cb-fc074ef76bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:33.286626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3bd6-6a51-4234-a1cb-fc074ef76bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.286909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3bd6-6a51-4234-a1cb-fc074ef76bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.287181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3bd6-6a51-4234-a1cb-fc074ef76bb4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.303173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd3bd6-6a51-4234-a1cb-fc074ef76bb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:33.315704 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-1fdd3bd6-6a51-4234-a1cb-fc074ef76bb4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:33.316999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 116/224] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:33.323890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3cb72-19fa-4df0-961c-6ef5498c495a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:33.340704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3cb72-19fa-4df0-961c-6ef5498c495a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:33.352069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ea473-50dd-47df-80d6-663209d077ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:33.352767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ea473-50dd-47df-80d6-663209d077ee admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.353376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ea473-50dd-47df-80d6-663209d077ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.353655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ea473-50dd-47df-80d6-663209d077ee admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.354419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ea473-50dd-47df-80d6-663209d077ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:33.354721 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ea473-50dd-47df-80d6-663209d077ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:33.356323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ea473-50dd-47df-80d6-663209d077ee admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:33.370821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 109/225] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:33.376973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd3bd6-6a51-4234-a1cb-fc074ef76bb4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:33.388675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd3bd6-6a51-4234-a1cb-fc074ef76bb4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:33.396490 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465a80-0a33-4671-876f-910679796884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:33.397366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465a80-0a33-4671-876f-910679796884 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.397651 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465a80-0a33-4671-876f-910679796884 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.397924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465a80-0a33-4671-876f-910679796884 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.405163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465a80-0a33-4671-876f-910679796884 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:33.407009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465a80-0a33-4671-876f-910679796884 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:33.409094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 117/226] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:33 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:33.415685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ea473-50dd-47df-80d6-663209d077ee admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:33.425822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ea473-50dd-47df-80d6-663209d077ee admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:33.436473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23a294-0e3d-4789-a24e-af3a03414620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:33.437123 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23a294-0e3d-4789-a24e-af3a03414620 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.437400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23a294-0e3d-4789-a24e-af3a03414620 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.437669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23a294-0e3d-4789-a24e-af3a03414620 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.449532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23a294-0e3d-4789-a24e-af3a03414620 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:33.451312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23a294-0e3d-4789-a24e-af3a03414620 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:33.465725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 110/227] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:33.472414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465a80-0a33-4671-876f-910679796884 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:33.495063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465a80-0a33-4671-876f-910679796884 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:33.504764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cf864-4cfb-4456-abc9-bef5613644a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:33.505646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cf864-4cfb-4456-abc9-bef5613644a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.505931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cf864-4cfb-4456-abc9-bef5613644a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.506206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cf864-4cfb-4456-abc9-bef5613644a7 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.510478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cf864-4cfb-4456-abc9-bef5613644a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:33.512730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cf864-4cfb-4456-abc9-bef5613644a7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:33.514863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 118/228] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:33 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:33.521405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23a294-0e3d-4789-a24e-af3a03414620 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:33.531664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23a294-0e3d-4789-a24e-af3a03414620 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:33.541366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccace181-c3d9-4962-8bb4-ef4c387bdf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:33.542033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccace181-c3d9-4962-8bb4-ef4c387bdf4d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.542313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccace181-c3d9-4962-8bb4-ef4c387bdf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.542584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccace181-c3d9-4962-8bb4-ef4c387bdf4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.543683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccace181-c3d9-4962-8bb4-ef4c387bdf4d admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8, user.id=a3eedbef815445d78eda15afd8ed2501) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:33.543984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccace181-c3d9-4962-8bb4-ef4c387bdf4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:33.546089 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccace181-c3d9-4962-8bb4-ef4c387bdf4d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:33.552781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 111/229] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:33 2021] GET /identity/v3/role_assignments?user.id=a3eedbef815445d78eda15afd8ed2501&scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:33.915250 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c655f-0795-4ffa-891c-a757492c1a70 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.915604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c655f-0795-4ffa-891c-a757492c1a70 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.915792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c655f-0795-4ffa-891c-a757492c1a70 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.917617 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 119/230] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:33.930074 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2c21f-47f3-4e0e-a043-d8d2110c28f5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.930345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2c21f-47f3-4e0e-a043-d8d2110c28f5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.930623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2c21f-47f3-4e0e-a043-d8d2110c28f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.957779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-71a2c21f-47f3-4e0e-a043-d8d2110c28f5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:33.959097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-71a2c21f-47f3-4e0e-a043-d8d2110c28f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:33.967748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 112/231] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:33.997911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c655f-0795-4ffa-891c-a757492c1a70 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.014628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c655f-0795-4ffa-891c-a757492c1a70 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.019183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76135afd-224f-4e91-aeb9-d5f71dcf1e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.019979 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135afd-224f-4e91-aeb9-d5f71dcf1e4c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.020264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135afd-224f-4e91-aeb9-d5f71dcf1e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.020565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135afd-224f-4e91-aeb9-d5f71dcf1e4c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.039927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76135afd-224f-4e91-aeb9-d5f71dcf1e4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:34.047114 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-76135afd-224f-4e91-aeb9-d5f71dcf1e4c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:34.048685 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 120/232] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:34.055588 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2c21f-47f3-4e0e-a043-d8d2110c28f5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.069189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2c21f-47f3-4e0e-a043-d8d2110c28f5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.076391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fec2f3-1273-41f1-a16c-ccc087f6c3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.077057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fec2f3-1273-41f1-a16c-ccc087f6c3bf admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.077333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fec2f3-1273-41f1-a16c-ccc087f6c3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.077601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fec2f3-1273-41f1-a16c-ccc087f6c3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.078364 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fec2f3-1273-41f1-a16c-ccc087f6c3bf admin admin] RBAC: Adding query filter params (name=member) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:34.078667 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fec2f3-1273-41f1-a16c-ccc087f6c3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.080272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fec2f3-1273-41f1-a16c-ccc087f6c3bf admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.095080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 113/233] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:34.101011 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76135afd-224f-4e91-aeb9-d5f71dcf1e4c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.118526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76135afd-224f-4e91-aeb9-d5f71dcf1e4c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.128476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da69b5-9ea6-4b29-85fa-4ebe55d50e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.129139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da69b5-9ea6-4b29-85fa-4ebe55d50e51 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.129427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da69b5-9ea6-4b29-85fa-4ebe55d50e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.129707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da69b5-9ea6-4b29-85fa-4ebe55d50e51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.148693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da69b5-9ea6-4b29-85fa-4ebe55d50e51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.150470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da69b5-9ea6-4b29-85fa-4ebe55d50e51 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.161958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 121/234] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:34.170222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fec2f3-1273-41f1-a16c-ccc087f6c3bf admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.185892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fec2f3-1273-41f1-a16c-ccc087f6c3bf admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.192964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d3de5-d340-45f7-8c00-8ec230d758a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.194202 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d3de5-d340-45f7-8c00-8ec230d758a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.194679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d3de5-d340-45f7-8c00-8ec230d758a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.195168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d3de5-d340-45f7-8c00-8ec230d758a3 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.197145 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d3de5-d340-45f7-8c00-8ec230d758a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.199518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d3de5-d340-45f7-8c00-8ec230d758a3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.201640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 114/235] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:34.208699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da69b5-9ea6-4b29-85fa-4ebe55d50e51 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.221802 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da69b5-9ea6-4b29-85fa-4ebe55d50e51 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.232568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1cf7e-e013-446e-b61f-85b3d8753ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.233438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1cf7e-e013-446e-b61f-85b3d8753ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.233720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1cf7e-e013-446e-b61f-85b3d8753ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.234002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1cf7e-e013-446e-b61f-85b3d8753ad2 admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.242842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1cf7e-e013-446e-b61f-85b3d8753ad2 admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.244175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-a3b1cf7e-e013-446e-b61f-85b3d8753ad2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:34.244175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:34.244175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:34.245809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1cf7e-e013-446e-b61f-85b3d8753ad2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.247914 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 122/236] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:34.254704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d3de5-d340-45f7-8c00-8ec230d758a3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.269439 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d3de5-d340-45f7-8c00-8ec230d758a3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.275033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9003f1a-4621-4f65-bc4a-6a8a4d3830df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.275918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003f1a-4621-4f65-bc4a-6a8a4d3830df admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.276412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003f1a-4621-4f65-bc4a-6a8a4d3830df admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.276879 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003f1a-4621-4f65-bc4a-6a8a4d3830df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.277927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9003f1a-4621-4f65-bc4a-6a8a4d3830df admin admin] RBAC: Adding query filter params (group.id=e92834b95f4d4a3d980f1a0730504803, role.id=70600290909e4c808126b1efb2142b05, scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:34.278438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9003f1a-4621-4f65-bc4a-6a8a4d3830df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.280534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9003f1a-4621-4f65-bc4a-6a8a4d3830df admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.286802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 115/237] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/role_assignments?group.id=e92834b95f4d4a3d980f1a0730504803&scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6&role.id=70600290909e4c808126b1efb2142b05 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:34.312767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376994c-be46-44fe-84fb-f8defc404308 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.313425 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376994c-be46-44fe-84fb-f8defc404308 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.313897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376994c-be46-44fe-84fb-f8defc404308 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.315862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 123/238] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:34.325366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a761a-8684-41c7-9393-fa8f42cfd2e7 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.326035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a761a-8684-41c7-9393-fa8f42cfd2e7 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.326527 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a761a-8684-41c7-9393-fa8f42cfd2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.353432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-bb9a761a-8684-41c7-9393-fa8f42cfd2e7 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:34.355092 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-bb9a761a-8684-41c7-9393-fa8f42cfd2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:34.366040 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 116/239] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:34.408543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376994c-be46-44fe-84fb-f8defc404308 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.426718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376994c-be46-44fe-84fb-f8defc404308 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.433390 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de8731-e8be-4314-9f20-e49dcfd8c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.434593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de8731-e8be-4314-9f20-e49dcfd8c458 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.435143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de8731-e8be-4314-9f20-e49dcfd8c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.435602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de8731-e8be-4314-9f20-e49dcfd8c458 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.453680 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de8731-e8be-4314-9f20-e49dcfd8c458 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:34.462738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-26de8731-e8be-4314-9f20-e49dcfd8c458 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:34.465531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 124/240] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:34.472781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a761a-8684-41c7-9393-fa8f42cfd2e7 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.483658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a761a-8684-41c7-9393-fa8f42cfd2e7 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.491452 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a3f5-5035-45e6-a1ff-ed02432669ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.492536 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a3f5-5035-45e6-a1ff-ed02432669ad admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.493016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a3f5-5035-45e6-a1ff-ed02432669ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.493480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a3f5-5035-45e6-a1ff-ed02432669ad admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.494451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071a3f5-5035-45e6-a1ff-ed02432669ad admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:34.495044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071a3f5-5035-45e6-a1ff-ed02432669ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.496972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071a3f5-5035-45e6-a1ff-ed02432669ad admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.506370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 117/241] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:34.512678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de8731-e8be-4314-9f20-e49dcfd8c458 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.525257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de8731-e8be-4314-9f20-e49dcfd8c458 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.530301 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecb009-7dc4-4fa1-8ee6-499eace48329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.531392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb009-7dc4-4fa1-8ee6-499eace48329 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.531934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb009-7dc4-4fa1-8ee6-499eace48329 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.532417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb009-7dc4-4fa1-8ee6-499eace48329 admin admin] PATH_INFO: `/v3/users/4172444346f24a05896f00771c673d03` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.534544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecb009-7dc4-4fa1-8ee6-499eace48329 admin admin] RBAC: Authorizing `identity:get_user(user_id=4172444346f24a05896f00771c673d03)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.537027 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecb009-7dc4-4fa1-8ee6-499eace48329 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.538962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 125/242] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/users/4172444346f24a05896f00771c673d03 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:34.546204 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a3f5-5035-45e6-a1ff-ed02432669ad admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.556955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a3f5-5035-45e6-a1ff-ed02432669ad admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.564086 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c007e2-0840-4e64-a41f-08519df3b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.565060 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c007e2-0840-4e64-a41f-08519df3b59b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.565554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c007e2-0840-4e64-a41f-08519df3b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.566068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c007e2-0840-4e64-a41f-08519df3b59b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.576632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c007e2-0840-4e64-a41f-08519df3b59b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.578840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c007e2-0840-4e64-a41f-08519df3b59b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.589338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 118/243] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:34.595858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecb009-7dc4-4fa1-8ee6-499eace48329 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.606366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecb009-7dc4-4fa1-8ee6-499eace48329 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.613203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301961e3-1cb0-43bb-8d33-ee6b551a17cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.614434 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301961e3-1cb0-43bb-8d33-ee6b551a17cc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.614913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301961e3-1cb0-43bb-8d33-ee6b551a17cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.615425 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301961e3-1cb0-43bb-8d33-ee6b551a17cc admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.616920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301961e3-1cb0-43bb-8d33-ee6b551a17cc admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.619487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301961e3-1cb0-43bb-8d33-ee6b551a17cc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.621495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 126/244] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:34.628666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c007e2-0840-4e64-a41f-08519df3b59b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.639533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c007e2-0840-4e64-a41f-08519df3b59b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.648312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463d964-4a9d-4df0-bd21-4bf40bccb532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.649990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d964-4a9d-4df0-bd21-4bf40bccb532 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.650649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d964-4a9d-4df0-bd21-4bf40bccb532 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.651146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d964-4a9d-4df0-bd21-4bf40bccb532 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.652188 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463d964-4a9d-4df0-bd21-4bf40bccb532 admin admin] RBAC: Adding query filter params (role.id=3df7162472e345bd91ce9469ee6fe3f5, scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8, user.id=4172444346f24a05896f00771c673d03) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:34.652716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463d964-4a9d-4df0-bd21-4bf40bccb532 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.654998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463d964-4a9d-4df0-bd21-4bf40bccb532 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.662598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 119/245] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/role_assignments?user.id=4172444346f24a05896f00771c673d03&scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8&role.id=3df7162472e345bd91ce9469ee6fe3f5 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:34.975881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee073-8d8e-4431-8f78-ce0545f3b7e1 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.976583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee073-8d8e-4431-8f78-ce0545f3b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.977129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee073-8d8e-4431-8f78-ce0545f3b7e1 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.979108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 127/246] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:34.991948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a8f24-d42c-4c58-9509-6708d7d00ac3 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.993179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a8f24-d42c-4c58-9509-6708d7d00ac3 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.993650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a8f24-d42c-4c58-9509-6708d7d00ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.017439 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-ff4a8f24-d42c-4c58-9509-6708d7d00ac3 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:35.018985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ff4a8f24-d42c-4c58-9509-6708d7d00ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:35.031647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 120/247] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:35.065076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caee073-8d8e-4431-8f78-ce0545f3b7e1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.082241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caee073-8d8e-4431-8f78-ce0545f3b7e1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.087142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefc3aa-4b3f-4397-8c94-42ac5736983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.088228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefc3aa-4b3f-4397-8c94-42ac5736983a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.088792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefc3aa-4b3f-4397-8c94-42ac5736983a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.089286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefc3aa-4b3f-4397-8c94-42ac5736983a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.102658 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefc3aa-4b3f-4397-8c94-42ac5736983a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:35.110195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-caefc3aa-4b3f-4397-8c94-42ac5736983a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:35.111627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 128/248] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:35.118978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a8f24-d42c-4c58-9509-6708d7d00ac3 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.128594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a8f24-d42c-4c58-9509-6708d7d00ac3 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.136982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9206fe-4ce4-4ada-85c1-76fcbdfed932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.137897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9206fe-4ce4-4ada-85c1-76fcbdfed932 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.138371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9206fe-4ce4-4ada-85c1-76fcbdfed932 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.138856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9206fe-4ce4-4ada-85c1-76fcbdfed932 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.139801 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9206fe-4ce4-4ada-85c1-76fcbdfed932 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:35.140305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9206fe-4ce4-4ada-85c1-76fcbdfed932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:35.142129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9206fe-4ce4-4ada-85c1-76fcbdfed932 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:35.151577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 121/249] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:35.158064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefc3aa-4b3f-4397-8c94-42ac5736983a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.169008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefc3aa-4b3f-4397-8c94-42ac5736983a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.175227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca528815-a794-48e4-887b-6e9251a8473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.176141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca528815-a794-48e4-887b-6e9251a8473d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.176735 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca528815-a794-48e4-887b-6e9251a8473d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.177270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca528815-a794-48e4-887b-6e9251a8473d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.189040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca528815-a794-48e4-887b-6e9251a8473d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:35.191088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca528815-a794-48e4-887b-6e9251a8473d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:35.202632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 129/250] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:35.209441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9206fe-4ce4-4ada-85c1-76fcbdfed932 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.220483 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9206fe-4ce4-4ada-85c1-76fcbdfed932 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.228394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827e6dc-01f0-4a04-b384-16ab9249162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.229664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827e6dc-01f0-4a04-b384-16ab9249162c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.230192 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827e6dc-01f0-4a04-b384-16ab9249162c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.230665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827e6dc-01f0-4a04-b384-16ab9249162c admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.232345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827e6dc-01f0-4a04-b384-16ab9249162c admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:35.234672 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827e6dc-01f0-4a04-b384-16ab9249162c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:35.236609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 122/251] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:35.243604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca528815-a794-48e4-887b-6e9251a8473d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.253313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca528815-a794-48e4-887b-6e9251a8473d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.259606 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610b3c7-4ec5-40ce-a596-a45a12cbe301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.260824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b3c7-4ec5-40ce-a596-a45a12cbe301 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.261448 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b3c7-4ec5-40ce-a596-a45a12cbe301 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.261930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b3c7-4ec5-40ce-a596-a45a12cbe301 admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.263467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610b3c7-4ec5-40ce-a596-a45a12cbe301 admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:35.266370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610b3c7-4ec5-40ce-a596-a45a12cbe301 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:35.268323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 130/252] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:35.274951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827e6dc-01f0-4a04-b384-16ab9249162c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.285104 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827e6dc-01f0-4a04-b384-16ab9249162c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.296330 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d8a63-6086-46a3-ab54-7ac7b0c426e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.297312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d8a63-6086-46a3-ab54-7ac7b0c426e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.297799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d8a63-6086-46a3-ab54-7ac7b0c426e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.298263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d8a63-6086-46a3-ab54-7ac7b0c426e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.299306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d8a63-6086-46a3-ab54-7ac7b0c426e4 admin admin] RBAC: Adding query filter params (group.id=e92834b95f4d4a3d980f1a0730504803, role.id=3df7162472e345bd91ce9469ee6fe3f5, scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:35.299810 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d8a63-6086-46a3-ab54-7ac7b0c426e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:35.301923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d8a63-6086-46a3-ab54-7ac7b0c426e4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:35.308844 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 123/253] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/role_assignments?group.id=e92834b95f4d4a3d980f1a0730504803&scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6&role.id=3df7162472e345bd91ce9469ee6fe3f5 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:35.452315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a014-1ca4-4170-8404-6f43539e961a None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.453059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a014-1ca4-4170-8404-6f43539e961a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.453549 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a014-1ca4-4170-8404-6f43539e961a None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.455989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 131/254] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:35.462111 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fef43-e895-408c-9ee8-8262cf20d7b1 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.462403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fef43-e895-408c-9ee8-8262cf20d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.462686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fef43-e895-408c-9ee8-8262cf20d7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.485383 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-182fef43-e895-408c-9ee8-8262cf20d7b1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:35.486520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-182fef43-e895-408c-9ee8-8262cf20d7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:35.496901 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 124/255] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:35.536609 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369a014-1ca4-4170-8404-6f43539e961a None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.553646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369a014-1ca4-4170-8404-6f43539e961a None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.558625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3335-1c08-446b-b66d-a8b7a9195740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.559525 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3335-1c08-446b-b66d-a8b7a9195740 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.559865 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3335-1c08-446b-b66d-a8b7a9195740 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.560148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3335-1c08-446b-b66d-a8b7a9195740 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.571667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f3335-1c08-446b-b66d-a8b7a9195740 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:35.583020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-a12f3335-1c08-446b-b66d-a8b7a9195740 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:35.584518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 132/256] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:35.590977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fef43-e895-408c-9ee8-8262cf20d7b1 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.604641 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fef43-e895-408c-9ee8-8262cf20d7b1 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.609201 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c5592-fc20-4a25-867a-926b0ecec793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.609876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c5592-fc20-4a25-867a-926b0ecec793 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.610267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c5592-fc20-4a25-867a-926b0ecec793 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.610548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c5592-fc20-4a25-867a-926b0ecec793 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.611372 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c5592-fc20-4a25-867a-926b0ecec793 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:35.611686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c5592-fc20-4a25-867a-926b0ecec793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:35.613321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c5592-fc20-4a25-867a-926b0ecec793 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:35.632001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 125/257] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:35.638357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3335-1c08-446b-b66d-a8b7a9195740 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.649757 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3335-1c08-446b-b66d-a8b7a9195740 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.657208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78fbb1-67da-4e95-b005-591e8eba9709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.658353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78fbb1-67da-4e95-b005-591e8eba9709 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.658842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78fbb1-67da-4e95-b005-591e8eba9709 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.659314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78fbb1-67da-4e95-b005-591e8eba9709 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.673599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78fbb1-67da-4e95-b005-591e8eba9709 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:35.675831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78fbb1-67da-4e95-b005-591e8eba9709 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:35.690926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 133/258] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:35.701877 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c5592-fc20-4a25-867a-926b0ecec793 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.715778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c5592-fc20-4a25-867a-926b0ecec793 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.720427 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dc79c-f396-4369-987a-53a23be22bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.721343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dc79c-f396-4369-987a-53a23be22bcc admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.721628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dc79c-f396-4369-987a-53a23be22bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.721956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dc79c-f396-4369-987a-53a23be22bcc admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.723239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dc79c-f396-4369-987a-53a23be22bcc admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:35.725555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dc79c-f396-4369-987a-53a23be22bcc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:35.732876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 126/259] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:35.735259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78fbb1-67da-4e95-b005-591e8eba9709 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.749536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78fbb1-67da-4e95-b005-591e8eba9709 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.757320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875692db-b42f-41b9-bec8-0deac935ecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.758494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875692db-b42f-41b9-bec8-0deac935ecdc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.758991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875692db-b42f-41b9-bec8-0deac935ecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.759472 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875692db-b42f-41b9-bec8-0deac935ecdc admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.764747 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875692db-b42f-41b9-bec8-0deac935ecdc admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:35.767155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875692db-b42f-41b9-bec8-0deac935ecdc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:35.769129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 134/260] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:35.776681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dc79c-f396-4369-987a-53a23be22bcc admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:35.790512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dc79c-f396-4369-987a-53a23be22bcc admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:35.795479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00633834-1088-4809-940f-751232c1fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:35.796148 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00633834-1088-4809-940f-751232c1fa1c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:35.796457 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00633834-1088-4809-940f-751232c1fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:35.796741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00633834-1088-4809-940f-751232c1fa1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:35.797663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00633834-1088-4809-940f-751232c1fa1c admin admin] RBAC: Adding query filter params (group.id=e92834b95f4d4a3d980f1a0730504803, role.id=70600290909e4c808126b1efb2142b05, scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:35.797982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00633834-1088-4809-940f-751232c1fa1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:35.800012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00633834-1088-4809-940f-751232c1fa1c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:35.813251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 127/261] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 04:24:35 2021] GET /identity/v3/role_assignments?group.id=e92834b95f4d4a3d980f1a0730504803&scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8&role.id=70600290909e4c808126b1efb2142b05 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:36.016229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624cc56-e59a-4a33-aed5-a5b93a5ef30b None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.016739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624cc56-e59a-4a33-aed5-a5b93a5ef30b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.017159 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624cc56-e59a-4a33-aed5-a5b93a5ef30b None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.019098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 135/262] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:36.026254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9159d2a-736a-459e-9a7c-cfce421e7403 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.026544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9159d2a-736a-459e-9a7c-cfce421e7403 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.026828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9159d2a-736a-459e-9a7c-cfce421e7403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.049235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-a9159d2a-736a-459e-9a7c-cfce421e7403 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:36.050479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a9159d2a-736a-459e-9a7c-cfce421e7403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:36.064491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 128/263] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:36.114047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624cc56-e59a-4a33-aed5-a5b93a5ef30b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:36.126972 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624cc56-e59a-4a33-aed5-a5b93a5ef30b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:36.136819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89412b18-7fe7-4757-abf0-8ab8a3d2beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:36.137646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412b18-7fe7-4757-abf0-8ab8a3d2beaf admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.137930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412b18-7fe7-4757-abf0-8ab8a3d2beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.138205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412b18-7fe7-4757-abf0-8ab8a3d2beaf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.150234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89412b18-7fe7-4757-abf0-8ab8a3d2beaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:36.157738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-89412b18-7fe7-4757-abf0-8ab8a3d2beaf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:36.159282 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 136/264] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:36.165687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9159d2a-736a-459e-9a7c-cfce421e7403 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:36.175257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9159d2a-736a-459e-9a7c-cfce421e7403 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:36.179786 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267dbf4-db11-46b3-b98a-4a1ef5859d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:36.180546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267dbf4-db11-46b3-b98a-4a1ef5859d40 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.180834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267dbf4-db11-46b3-b98a-4a1ef5859d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.181163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267dbf4-db11-46b3-b98a-4a1ef5859d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.181917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267dbf4-db11-46b3-b98a-4a1ef5859d40 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:36.182279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267dbf4-db11-46b3-b98a-4a1ef5859d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:36.183893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267dbf4-db11-46b3-b98a-4a1ef5859d40 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:36.194685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 129/265] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:36.201811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89412b18-7fe7-4757-abf0-8ab8a3d2beaf admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:36.212536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89412b18-7fe7-4757-abf0-8ab8a3d2beaf admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:36.217938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c36fb-bb3e-4df6-997c-3b999ef2d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:36.218643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c36fb-bb3e-4df6-997c-3b999ef2d742 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.218930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c36fb-bb3e-4df6-997c-3b999ef2d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.219264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c36fb-bb3e-4df6-997c-3b999ef2d742 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.228568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c36fb-bb3e-4df6-997c-3b999ef2d742 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:36.230396 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c36fb-bb3e-4df6-997c-3b999ef2d742 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:36.242309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 137/266] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:36.248776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267dbf4-db11-46b3-b98a-4a1ef5859d40 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:36.265362 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267dbf4-db11-46b3-b98a-4a1ef5859d40 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:36.272538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663feb4d-2ec3-4c49-9684-622b8797d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:36.273332 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663feb4d-2ec3-4c49-9684-622b8797d7cc admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.273676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663feb4d-2ec3-4c49-9684-622b8797d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.274450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663feb4d-2ec3-4c49-9684-622b8797d7cc admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.281185 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663feb4d-2ec3-4c49-9684-622b8797d7cc admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:36.283308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663feb4d-2ec3-4c49-9684-622b8797d7cc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:36.286727 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 130/267] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:36 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:36.291648 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c36fb-bb3e-4df6-997c-3b999ef2d742 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:36.304788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c36fb-bb3e-4df6-997c-3b999ef2d742 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:36.309610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d50d3-ab0d-4946-9f9b-23ef05920e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:36.310472 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d50d3-ab0d-4946-9f9b-23ef05920e99 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.316759 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d50d3-ab0d-4946-9f9b-23ef05920e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.317052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d50d3-ab0d-4946-9f9b-23ef05920e99 admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.318366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d50d3-ab0d-4946-9f9b-23ef05920e99 admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:36.320338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d50d3-ab0d-4946-9f9b-23ef05920e99 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:36.322752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 138/268] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:36 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:36.329464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663feb4d-2ec3-4c49-9684-622b8797d7cc admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:36.345779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663feb4d-2ec3-4c49-9684-622b8797d7cc admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:36.356566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcffbfa-e3cf-4906-b391-674b84116f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:36.357539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcffbfa-e3cf-4906-b391-674b84116f95 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.358046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcffbfa-e3cf-4906-b391-674b84116f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.358522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcffbfa-e3cf-4906-b391-674b84116f95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.359582 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcffbfa-e3cf-4906-b391-674b84116f95 admin admin] RBAC: Adding query filter params (group.id=e92834b95f4d4a3d980f1a0730504803, role.id=3df7162472e345bd91ce9469ee6fe3f5, scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:36.360094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcffbfa-e3cf-4906-b391-674b84116f95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:36.362232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcffbfa-e3cf-4906-b391-674b84116f95 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:36.372735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 131/269] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 04:24:36 2021] GET /identity/v3/role_assignments?group.id=e92834b95f4d4a3d980f1a0730504803&scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8&role.id=3df7162472e345bd91ce9469ee6fe3f5 => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:36.738236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2c31c-51e1-4b69-90c3-69deea259487 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.738807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2c31c-51e1-4b69-90c3-69deea259487 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.739265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2c31c-51e1-4b69-90c3-69deea259487 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.741326 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 139/270] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:36.747943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455a995-5486-4f54-8601-4528954fdf69 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.748315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455a995-5486-4f54-8601-4528954fdf69 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.748621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455a995-5486-4f54-8601-4528954fdf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.776379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d455a995-5486-4f54-8601-4528954fdf69 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:36.777569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d455a995-5486-4f54-8601-4528954fdf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:36.795035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 132/271] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:36.830974 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2c31c-51e1-4b69-90c3-69deea259487 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:36.844058 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2c31c-51e1-4b69-90c3-69deea259487 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:36.854647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176c8f7-9283-48fd-804b-0e0c1cd228f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:36.855776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176c8f7-9283-48fd-804b-0e0c1cd228f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.856309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176c8f7-9283-48fd-804b-0e0c1cd228f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.856830 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176c8f7-9283-48fd-804b-0e0c1cd228f6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.872688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176c8f7-9283-48fd-804b-0e0c1cd228f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:36.880183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-6176c8f7-9283-48fd-804b-0e0c1cd228f6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:36.882076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 140/272] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:36.890064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455a995-5486-4f54-8601-4528954fdf69 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:36.899363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455a995-5486-4f54-8601-4528954fdf69 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:36.912056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff274a-93ec-4103-ae9a-f09ce7f7749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:36.912739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff274a-93ec-4103-ae9a-f09ce7f7749b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.913021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff274a-93ec-4103-ae9a-f09ce7f7749b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.913291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff274a-93ec-4103-ae9a-f09ce7f7749b admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.914068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff274a-93ec-4103-ae9a-f09ce7f7749b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:36.914908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff274a-93ec-4103-ae9a-f09ce7f7749b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:36.916541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff274a-93ec-4103-ae9a-f09ce7f7749b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:36.932895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 133/273] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:36.939057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176c8f7-9283-48fd-804b-0e0c1cd228f6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:36.949800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176c8f7-9283-48fd-804b-0e0c1cd228f6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:36.960212 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76019-73f4-4700-91aa-4934e82c2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:36.961376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76019-73f4-4700-91aa-4934e82c2779 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:36.961863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76019-73f4-4700-91aa-4934e82c2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:36.962335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76019-73f4-4700-91aa-4934e82c2779 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:36.972524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c76019-73f4-4700-91aa-4934e82c2779 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:36.974694 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c76019-73f4-4700-91aa-4934e82c2779 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:36.986648 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 141/274] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:36.993974 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff274a-93ec-4103-ae9a-f09ce7f7749b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:37.010505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff274a-93ec-4103-ae9a-f09ce7f7749b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:37.019166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9c14-033e-4b27-b434-12eb8a9e29d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:37.020154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9c14-033e-4b27-b434-12eb8a9e29d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.020466 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9c14-033e-4b27-b434-12eb8a9e29d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.020742 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9c14-033e-4b27-b434-12eb8a9e29d8 admin admin] PATH_INFO: `/v3/projects/28c22cecb66d4652809a04ec1798ad5b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.025389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee9c14-033e-4b27-b434-12eb8a9e29d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=28c22cecb66d4652809a04ec1798ad5b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:37.027351 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee9c14-033e-4b27-b434-12eb8a9e29d8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:37.029155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 134/275] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:36 2021] GET /identity/v3/projects/28c22cecb66d4652809a04ec1798ad5b => generated 344 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:37.035617 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76019-73f4-4700-91aa-4934e82c2779 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:37.046486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76019-73f4-4700-91aa-4934e82c2779 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:37.053521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c7e78-ce18-4663-85f0-08b267082efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:37.054700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c7e78-ce18-4663-85f0-08b267082efe admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.055763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c7e78-ce18-4663-85f0-08b267082efe admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.056293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c7e78-ce18-4663-85f0-08b267082efe admin admin] PATH_INFO: `/v3/groups/3f3ad51a3e414508bf408efe9e34e4e7` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.062282 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c7e78-ce18-4663-85f0-08b267082efe admin admin] RBAC: Authorizing `identity:get_group(group_id=3f3ad51a3e414508bf408efe9e34e4e7)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:37.066934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c7e78-ce18-4663-85f0-08b267082efe admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:37.069511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 142/276] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:37 2021] GET /identity/v3/groups/3f3ad51a3e414508bf408efe9e34e4e7 => generated 229 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:37.078728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9c14-033e-4b27-b434-12eb8a9e29d8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:37.089682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9c14-033e-4b27-b434-12eb8a9e29d8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:37.101093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce604e1f-5097-42e0-a1e8-39d03089f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:37.102305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce604e1f-5097-42e0-a1e8-39d03089f262 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.102584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce604e1f-5097-42e0-a1e8-39d03089f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.102863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce604e1f-5097-42e0-a1e8-39d03089f262 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.103783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce604e1f-5097-42e0-a1e8-39d03089f262 admin admin] RBAC: Adding query filter params (group.id=3f3ad51a3e414508bf408efe9e34e4e7, role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=28c22cecb66d4652809a04ec1798ad5b) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:37.104095 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce604e1f-5097-42e0-a1e8-39d03089f262 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:37.106065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce604e1f-5097-42e0-a1e8-39d03089f262 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:37.112819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 135/277] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 04:24:37 2021] GET /identity/v3/role_assignments?group.id=3f3ad51a3e414508bf408efe9e34e4e7&scope.project.id=28c22cecb66d4652809a04ec1798ad5b&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:37.174179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17b566-2faf-4c94-a380-c641ec1fba24 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.174801 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17b566-2faf-4c94-a380-c641ec1fba24 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.175284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17b566-2faf-4c94-a380-c641ec1fba24 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.177745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 143/278] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:37.184538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5cbc8-a42d-4ad5-9d5f-d1a077486e05 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.184828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5cbc8-a42d-4ad5-9d5f-d1a077486e05 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.185093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5cbc8-a42d-4ad5-9d5f-d1a077486e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.213713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-44f5cbc8-a42d-4ad5-9d5f-d1a077486e05 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:37.214881 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-44f5cbc8-a42d-4ad5-9d5f-d1a077486e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:37.224893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 136/279] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:37.268074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17b566-2faf-4c94-a380-c641ec1fba24 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:37.283634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17b566-2faf-4c94-a380-c641ec1fba24 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:37.292797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857f143-ca4c-4b27-b21d-66fbead330ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:37.294245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857f143-ca4c-4b27-b21d-66fbead330ed admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.294793 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857f143-ca4c-4b27-b21d-66fbead330ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.295272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857f143-ca4c-4b27-b21d-66fbead330ed admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.313555 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857f143-ca4c-4b27-b21d-66fbead330ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:37.321388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-4857f143-ca4c-4b27-b21d-66fbead330ed admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:37.323399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 144/280] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:37.329653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5cbc8-a42d-4ad5-9d5f-d1a077486e05 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:37.339905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5cbc8-a42d-4ad5-9d5f-d1a077486e05 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:37.354920 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c831b-85a7-4d6a-b76c-b28271670f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:37.355661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c831b-85a7-4d6a-b76c-b28271670f66 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.355945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c831b-85a7-4d6a-b76c-b28271670f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.356422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c831b-85a7-4d6a-b76c-b28271670f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.357189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c831b-85a7-4d6a-b76c-b28271670f66 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:37.357496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c831b-85a7-4d6a-b76c-b28271670f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:37.359113 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c831b-85a7-4d6a-b76c-b28271670f66 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:37.369632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 137/281] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:37.375981 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857f143-ca4c-4b27-b21d-66fbead330ed admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:37.386918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857f143-ca4c-4b27-b21d-66fbead330ed admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:37.393855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afede06-8d7a-41cf-8be9-a8f2d1b2c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:37.395017 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afede06-8d7a-41cf-8be9-a8f2d1b2c086 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.395528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afede06-8d7a-41cf-8be9-a8f2d1b2c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.396074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afede06-8d7a-41cf-8be9-a8f2d1b2c086 admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.397526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afede06-8d7a-41cf-8be9-a8f2d1b2c086 admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:37.400371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afede06-8d7a-41cf-8be9-a8f2d1b2c086 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:37.402560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 145/282] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:37 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:37.408525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c831b-85a7-4d6a-b76c-b28271670f66 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:37.421661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c831b-85a7-4d6a-b76c-b28271670f66 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:37.432588 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f81877-8e6c-43a9-b475-9af0a3331381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:37.433458 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81877-8e6c-43a9-b475-9af0a3331381 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.433741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81877-8e6c-43a9-b475-9af0a3331381 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.434014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81877-8e6c-43a9-b475-9af0a3331381 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.441307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f81877-8e6c-43a9-b475-9af0a3331381 admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:37.443429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f81877-8e6c-43a9-b475-9af0a3331381 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:37.445222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 138/283] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:37 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:37.451734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afede06-8d7a-41cf-8be9-a8f2d1b2c086 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:37.574972 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afede06-8d7a-41cf-8be9-a8f2d1b2c086 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:37.583995 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e858c06-d338-4258-af05-5ae8823b9ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:37.585173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e858c06-d338-4258-af05-5ae8823b9ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.585663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e858c06-d338-4258-af05-5ae8823b9ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.586703 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e858c06-d338-4258-af05-5ae8823b9ffa admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6/groups/e92834b95f4d4a3d980f1a0730504803/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.588987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e858c06-d338-4258-af05-5ae8823b9ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5d1c3997b74a6dadceb4fb555cf0e6, group_id=e92834b95f4d4a3d980f1a0730504803, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:37.592006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e858c06-d338-4258-af05-5ae8823b9ffa admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:37.686970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 146/284] 10.222.0.25 () {58 vars in 1464 bytes} [Fri Aug 27 04:24:37 2021] PUT /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6/groups/e92834b95f4d4a3d980f1a0730504803/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:38.149322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3082-8626-4d08-b223-cf066fa91caf None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:38.149720 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3082-8626-4d08-b223-cf066fa91caf None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:38.149898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3082-8626-4d08-b223-cf066fa91caf None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:38.151990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 139/285] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:38.159534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d500b28-1e88-45f1-b742-6b81a6ae4071 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:38.160161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d500b28-1e88-45f1-b742-6b81a6ae4071 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:38.160704 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d500b28-1e88-45f1-b742-6b81a6ae4071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:38.180835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-9d500b28-1e88-45f1-b742-6b81a6ae4071 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:38.182379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9d500b28-1e88-45f1-b742-6b81a6ae4071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:38.243655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 147/286] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:38.268469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b3082-8626-4d08-b223-cf066fa91caf None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:38.291331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b3082-8626-4d08-b223-cf066fa91caf None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:38.299665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788233-11cf-4d15-93ae-b9d831a1365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:38.300512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788233-11cf-4d15-93ae-b9d831a1365a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:38.300796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788233-11cf-4d15-93ae-b9d831a1365a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:38.301069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788233-11cf-4d15-93ae-b9d831a1365a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:38.322157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8788233-11cf-4d15-93ae-b9d831a1365a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:38.329470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-b8788233-11cf-4d15-93ae-b9d831a1365a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:38.330878 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 140/287] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:38.338059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d500b28-1e88-45f1-b742-6b81a6ae4071 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:38.352380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d500b28-1e88-45f1-b742-6b81a6ae4071 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:38.357722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b3ab3-4aa8-4663-beac-fd09d4dcbb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:38.358681 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3ab3-4aa8-4663-beac-fd09d4dcbb81 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:38.359166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3ab3-4aa8-4663-beac-fd09d4dcbb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:38.359639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3ab3-4aa8-4663-beac-fd09d4dcbb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:38.360683 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b3ab3-4aa8-4663-beac-fd09d4dcbb81 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:38.361215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b3ab3-4aa8-4663-beac-fd09d4dcbb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:38.363154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b3ab3-4aa8-4663-beac-fd09d4dcbb81 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:38.377113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 148/288] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:38.383637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788233-11cf-4d15-93ae-b9d831a1365a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:38.402632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788233-11cf-4d15-93ae-b9d831a1365a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:38.407059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1f675-518a-405c-a97a-6379f6247c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:38.407892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1f675-518a-405c-a97a-6379f6247c46 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:38.408170 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1f675-518a-405c-a97a-6379f6247c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:38.408469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1f675-518a-405c-a97a-6379f6247c46 admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:38.413061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1f675-518a-405c-a97a-6379f6247c46 admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:38.414093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-6ec1f675-518a-405c-a97a-6379f6247c46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:38.414093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:38.414093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:38.415815 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1f675-518a-405c-a97a-6379f6247c46 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:38.417776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 141/289] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:38 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:38.423900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b3ab3-4aa8-4663-beac-fd09d4dcbb81 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:38.440379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b3ab3-4aa8-4663-beac-fd09d4dcbb81 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:38.445357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2ea5f-583b-453e-abba-b7a8dd8df53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:38.446473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ea5f-583b-453e-abba-b7a8dd8df53f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:38.447000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ea5f-583b-453e-abba-b7a8dd8df53f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:38.447502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ea5f-583b-453e-abba-b7a8dd8df53f admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:38.448977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2ea5f-583b-453e-abba-b7a8dd8df53f admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:38.451249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2ea5f-583b-453e-abba-b7a8dd8df53f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:38.453622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 149/290] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:38 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:38.460023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1f675-518a-405c-a97a-6379f6247c46 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:38.470049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1f675-518a-405c-a97a-6379f6247c46 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:38.485022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c429f-b80c-4acf-9f95-754d8cae8ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:38.485909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c429f-b80c-4acf-9f95-754d8cae8ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:38.486192 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c429f-b80c-4acf-9f95-754d8cae8ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:38.486463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c429f-b80c-4acf-9f95-754d8cae8ec7 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6/groups/e92834b95f4d4a3d980f1a0730504803/roles/3df7162472e345bd91ce9469ee6fe3f5` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:38.488758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c429f-b80c-4acf-9f95-754d8cae8ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5d1c3997b74a6dadceb4fb555cf0e6, group_id=e92834b95f4d4a3d980f1a0730504803, role_id=3df7162472e345bd91ce9469ee6fe3f5)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:38.491418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c429f-b80c-4acf-9f95-754d8cae8ec7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:38.583390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 142/291] 10.222.0.25 () {58 vars in 1464 bytes} [Fri Aug 27 04:24:38 2021] PUT /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6/groups/e92834b95f4d4a3d980f1a0730504803/roles/3df7162472e345bd91ce9469ee6fe3f5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:38.965335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af94ba-6c1a-463a-9831-c95dc93a95e9 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:38.965519 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af94ba-6c1a-463a-9831-c95dc93a95e9 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:38.965795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af94ba-6c1a-463a-9831-c95dc93a95e9 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:38.968136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 150/292] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:38.974225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb64f5-d4dd-4f2c-a636-617c829b9198 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:38.974510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb64f5-d4dd-4f2c-a636-617c829b9198 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:38.974783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb64f5-d4dd-4f2c-a636-617c829b9198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.001445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c8fb64f5-d4dd-4f2c-a636-617c829b9198 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:39.002657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c8fb64f5-d4dd-4f2c-a636-617c829b9198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:39.074010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 143/293] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:39.106164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af94ba-6c1a-463a-9831-c95dc93a95e9 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:39.118549 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af94ba-6c1a-463a-9831-c95dc93a95e9 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:39.128339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc594-e403-4bbb-b86d-b5482971ff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:39.129164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc594-e403-4bbb-b86d-b5482971ff28 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.129442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc594-e403-4bbb-b86d-b5482971ff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.129711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc594-e403-4bbb-b86d-b5482971ff28 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.144867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bc594-e403-4bbb-b86d-b5482971ff28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:39.152286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-221bc594-e403-4bbb-b86d-b5482971ff28 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:39.153739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 151/294] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:39.160193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb64f5-d4dd-4f2c-a636-617c829b9198 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:39.171066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb64f5-d4dd-4f2c-a636-617c829b9198 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:39.179428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43de6-fd4f-4bd8-a096-f4c5a2d27e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:39.180145 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43de6-fd4f-4bd8-a096-f4c5a2d27e3d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.180446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43de6-fd4f-4bd8-a096-f4c5a2d27e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.180723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43de6-fd4f-4bd8-a096-f4c5a2d27e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.181487 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43de6-fd4f-4bd8-a096-f4c5a2d27e3d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:39.181794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43de6-fd4f-4bd8-a096-f4c5a2d27e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:39.183423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43de6-fd4f-4bd8-a096-f4c5a2d27e3d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:39.197283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 144/295] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:39.203420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc594-e403-4bbb-b86d-b5482971ff28 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:39.215853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc594-e403-4bbb-b86d-b5482971ff28 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:39.224484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febaf95-5335-4f61-8c3c-221090f6dbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:39.225337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febaf95-5335-4f61-8c3c-221090f6dbaa admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.225616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febaf95-5335-4f61-8c3c-221090f6dbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.225885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febaf95-5335-4f61-8c3c-221090f6dbaa admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.227096 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febaf95-5335-4f61-8c3c-221090f6dbaa admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:39.229037 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febaf95-5335-4f61-8c3c-221090f6dbaa admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:39.230942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 152/296] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:39 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:39.237143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43de6-fd4f-4bd8-a096-f4c5a2d27e3d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:39.249255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43de6-fd4f-4bd8-a096-f4c5a2d27e3d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:39.256962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d3d82-3ee7-4ae0-82bb-61b012a9b828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:39.257815 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3d82-3ee7-4ae0-82bb-61b012a9b828 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.258623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3d82-3ee7-4ae0-82bb-61b012a9b828 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.258893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3d82-3ee7-4ae0-82bb-61b012a9b828 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.260100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d3d82-3ee7-4ae0-82bb-61b012a9b828 admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:39.262320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d3d82-3ee7-4ae0-82bb-61b012a9b828 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:39.264237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 145/297] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:39 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:39.270617 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febaf95-5335-4f61-8c3c-221090f6dbaa admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:39.285442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febaf95-5335-4f61-8c3c-221090f6dbaa admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:39.290066 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a90982-6332-444e-ab02-c670d685567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:39.290937 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90982-6332-444e-ab02-c670d685567b admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.291217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90982-6332-444e-ab02-c670d685567b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.294444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90982-6332-444e-ab02-c670d685567b admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8/groups/e92834b95f4d4a3d980f1a0730504803/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.296685 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a90982-6332-444e-ab02-c670d685567b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a76e9656c64e7ea5e88bdd2440c8d8, group_id=e92834b95f4d4a3d980f1a0730504803, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:39.299206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a90982-6332-444e-ab02-c670d685567b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:39.397157 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 153/298] 10.222.0.25 () {58 vars in 1464 bytes} [Fri Aug 27 04:24:39 2021] PUT /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8/groups/e92834b95f4d4a3d980f1a0730504803/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:39.419630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4331f1-89d9-45d3-b016-72be821bf21d None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.420337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4331f1-89d9-45d3-b016-72be821bf21d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.420337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4331f1-89d9-45d3-b016-72be821bf21d None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.422075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 146/299] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:39.428595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4145d65-27d0-484e-907f-120cb8a4b9a1 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.428892 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4145d65-27d0-484e-907f-120cb8a4b9a1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.429188 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4145d65-27d0-484e-907f-120cb8a4b9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.452028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b4145d65-27d0-484e-907f-120cb8a4b9a1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:39.453278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b4145d65-27d0-484e-907f-120cb8a4b9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:39.538884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 154/300] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:39.580203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4331f1-89d9-45d3-b016-72be821bf21d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:39.602648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4331f1-89d9-45d3-b016-72be821bf21d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:39.611164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4d90a-bd57-48fe-b6f1-dc21f74f01cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:39.611999 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4d90a-bd57-48fe-b6f1-dc21f74f01cc admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.612277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4d90a-bd57-48fe-b6f1-dc21f74f01cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.612575 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4d90a-bd57-48fe-b6f1-dc21f74f01cc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.626567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4d90a-bd57-48fe-b6f1-dc21f74f01cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:39.634587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-8fd4d90a-bd57-48fe-b6f1-dc21f74f01cc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:39.636195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 147/301] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:39.642630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4145d65-27d0-484e-907f-120cb8a4b9a1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:39.657748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4145d65-27d0-484e-907f-120cb8a4b9a1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:39.669037 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17820efc-b26b-4478-a950-1f2e5bb3b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:39.669721 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17820efc-b26b-4478-a950-1f2e5bb3b852 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.670005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17820efc-b26b-4478-a950-1f2e5bb3b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.670278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17820efc-b26b-4478-a950-1f2e5bb3b852 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.671043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17820efc-b26b-4478-a950-1f2e5bb3b852 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:39.671347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17820efc-b26b-4478-a950-1f2e5bb3b852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:39.672985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17820efc-b26b-4478-a950-1f2e5bb3b852 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:39.693291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 155/302] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:39.697895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4d90a-bd57-48fe-b6f1-dc21f74f01cc admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:39.714947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4d90a-bd57-48fe-b6f1-dc21f74f01cc admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:39.721758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5622b5-ac3f-4480-92d0-2ddb664820b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:39.722561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5622b5-ac3f-4480-92d0-2ddb664820b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.722834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5622b5-ac3f-4480-92d0-2ddb664820b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.723105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5622b5-ac3f-4480-92d0-2ddb664820b7 admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.724302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5622b5-ac3f-4480-92d0-2ddb664820b7 admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:39.726247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5622b5-ac3f-4480-92d0-2ddb664820b7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:39.728053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 148/303] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:39 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:39.734063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17820efc-b26b-4478-a950-1f2e5bb3b852 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:39.747906 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17820efc-b26b-4478-a950-1f2e5bb3b852 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:39.754791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e552813-f96b-4826-8235-3e62ab3a7657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:39.755657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552813-f96b-4826-8235-3e62ab3a7657 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.755934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552813-f96b-4826-8235-3e62ab3a7657 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.756203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552813-f96b-4826-8235-3e62ab3a7657 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.758829 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e552813-f96b-4826-8235-3e62ab3a7657 admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:39.760926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e552813-f96b-4826-8235-3e62ab3a7657 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:39.762667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 156/304] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:39 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:39.768943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5622b5-ac3f-4480-92d0-2ddb664820b7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:39.780707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5622b5-ac3f-4480-92d0-2ddb664820b7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:39.790074 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e04d30-51e5-4394-b0b7-6e6a0226ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:39.790885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04d30-51e5-4394-b0b7-6e6a0226ffd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:39.791162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04d30-51e5-4394-b0b7-6e6a0226ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:39.791429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04d30-51e5-4394-b0b7-6e6a0226ffd6 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8/groups/e92834b95f4d4a3d980f1a0730504803/roles/3df7162472e345bd91ce9469ee6fe3f5` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:39.795031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e04d30-51e5-4394-b0b7-6e6a0226ffd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a76e9656c64e7ea5e88bdd2440c8d8, group_id=e92834b95f4d4a3d980f1a0730504803, role_id=3df7162472e345bd91ce9469ee6fe3f5)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:39.797766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e04d30-51e5-4394-b0b7-6e6a0226ffd6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:39.886581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 149/305] 10.222.0.25 () {58 vars in 1464 bytes} [Fri Aug 27 04:24:39 2021] PUT /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8/groups/e92834b95f4d4a3d980f1a0730504803/roles/3df7162472e345bd91ce9469ee6fe3f5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:40.019120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbb7b7-faac-42ef-ae20-6a6d48469119 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.019477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbb7b7-faac-42ef-ae20-6a6d48469119 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.019721 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbb7b7-faac-42ef-ae20-6a6d48469119 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.021537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 157/306] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:40.028579 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a87ae-7104-45a7-8459-9c7b60f57cda None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.029181 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a87ae-7104-45a7-8459-9c7b60f57cda None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.029666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a87ae-7104-45a7-8459-9c7b60f57cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.049124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-f69a87ae-7104-45a7-8459-9c7b60f57cda None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:40.050713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f69a87ae-7104-45a7-8459-9c7b60f57cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:40.124593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 150/307] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:40.150514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbb7b7-faac-42ef-ae20-6a6d48469119 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.166637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbb7b7-faac-42ef-ae20-6a6d48469119 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.172042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb527a92-63c9-4fb0-b5e4-edb0b2699bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.173347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb527a92-63c9-4fb0-b5e4-edb0b2699bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.173849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb527a92-63c9-4fb0-b5e4-edb0b2699bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.174333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb527a92-63c9-4fb0-b5e4-edb0b2699bc3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.191048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb527a92-63c9-4fb0-b5e4-edb0b2699bc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:40.199270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-bb527a92-63c9-4fb0-b5e4-edb0b2699bc3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:40.201246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 158/308] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:40.207386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a87ae-7104-45a7-8459-9c7b60f57cda None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.221114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a87ae-7104-45a7-8459-9c7b60f57cda None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.226359 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c033d-3087-49cc-9c00-08b023eb8a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.227317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c033d-3087-49cc-9c00-08b023eb8a36 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.227802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c033d-3087-49cc-9c00-08b023eb8a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.228278 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c033d-3087-49cc-9c00-08b023eb8a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.229341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c033d-3087-49cc-9c00-08b023eb8a36 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:40.229903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c033d-3087-49cc-9c00-08b023eb8a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:40.231717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c033d-3087-49cc-9c00-08b023eb8a36 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:40.241164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 151/309] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:40.248489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb527a92-63c9-4fb0-b5e4-edb0b2699bc3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.261130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb527a92-63c9-4fb0-b5e4-edb0b2699bc3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.266186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec36bf3-a27d-4964-a7a2-8fd91bd59624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.267346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec36bf3-a27d-4964-a7a2-8fd91bd59624 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.267894 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec36bf3-a27d-4964-a7a2-8fd91bd59624 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.268485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec36bf3-a27d-4964-a7a2-8fd91bd59624 admin admin] PATH_INFO: `/v3/groups/3f3ad51a3e414508bf408efe9e34e4e7` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.269939 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec36bf3-a27d-4964-a7a2-8fd91bd59624 admin admin] RBAC: Authorizing `identity:get_group(group_id=3f3ad51a3e414508bf408efe9e34e4e7)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:40.272148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec36bf3-a27d-4964-a7a2-8fd91bd59624 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:40.274447 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 159/310] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:40 2021] GET /identity/v3/groups/3f3ad51a3e414508bf408efe9e34e4e7 => generated 229 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:40.280244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c033d-3087-49cc-9c00-08b023eb8a36 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.290597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c033d-3087-49cc-9c00-08b023eb8a36 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.295703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe75fe-8a65-4d4c-97e8-934e8383bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.296819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe75fe-8a65-4d4c-97e8-934e8383bcce admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.297290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe75fe-8a65-4d4c-97e8-934e8383bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.297710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe75fe-8a65-4d4c-97e8-934e8383bcce admin admin] PATH_INFO: `/v3/projects/28c22cecb66d4652809a04ec1798ad5b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.299102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe75fe-8a65-4d4c-97e8-934e8383bcce admin admin] RBAC: Authorizing `identity:get_project(project_id=28c22cecb66d4652809a04ec1798ad5b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:40.301357 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe75fe-8a65-4d4c-97e8-934e8383bcce admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:40.303594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 152/311] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:40 2021] GET /identity/v3/projects/28c22cecb66d4652809a04ec1798ad5b => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:40.310104 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec36bf3-a27d-4964-a7a2-8fd91bd59624 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.321157 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec36bf3-a27d-4964-a7a2-8fd91bd59624 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.326278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762be4eb-318c-450a-98f3-66622acd0947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.327376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762be4eb-318c-450a-98f3-66622acd0947 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.327827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762be4eb-318c-450a-98f3-66622acd0947 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.328248 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762be4eb-318c-450a-98f3-66622acd0947 admin admin] PATH_INFO: `/v3/projects/28c22cecb66d4652809a04ec1798ad5b/groups/3f3ad51a3e414508bf408efe9e34e4e7/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.330531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762be4eb-318c-450a-98f3-66622acd0947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c22cecb66d4652809a04ec1798ad5b, group_id=3f3ad51a3e414508bf408efe9e34e4e7, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:40.333524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762be4eb-318c-450a-98f3-66622acd0947 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:40.430820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 160/312] 10.222.0.25 () {58 vars in 1464 bytes} [Fri Aug 27 04:24:40 2021] PUT /identity/v3/projects/28c22cecb66d4652809a04ec1798ad5b/groups/3f3ad51a3e414508bf408efe9e34e4e7/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:40.566082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7857e2f-1934-450c-b327-b86ba3542e24 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.566991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7857e2f-1934-450c-b327-b86ba3542e24 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.567415 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7857e2f-1934-450c-b327-b86ba3542e24 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.569873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 153/313] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:40.576591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6cb7-6f1b-4f77-805b-c09330b0660f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.577208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6cb7-6f1b-4f77-805b-c09330b0660f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.577633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6cb7-6f1b-4f77-805b-c09330b0660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.601728 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a02c6cb7-6f1b-4f77-805b-c09330b0660f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:40.603210 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a02c6cb7-6f1b-4f77-805b-c09330b0660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:40.687854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 161/314] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:40.727218 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7857e2f-1934-450c-b327-b86ba3542e24 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.741802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7857e2f-1934-450c-b327-b86ba3542e24 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.746790 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd535944-20c6-4fc9-846b-c50b30b57986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.747942 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd535944-20c6-4fc9-846b-c50b30b57986 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.748500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd535944-20c6-4fc9-846b-c50b30b57986 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.748914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd535944-20c6-4fc9-846b-c50b30b57986 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.767247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd535944-20c6-4fc9-846b-c50b30b57986 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:40.775433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-dd535944-20c6-4fc9-846b-c50b30b57986 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:40.776839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 154/315] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:40.783271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c6cb7-6f1b-4f77-805b-c09330b0660f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.792948 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c6cb7-6f1b-4f77-805b-c09330b0660f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.799858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81abe5-1e3c-4849-803d-b4dabd46d491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.800752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81abe5-1e3c-4849-803d-b4dabd46d491 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.801230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81abe5-1e3c-4849-803d-b4dabd46d491 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.801671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81abe5-1e3c-4849-803d-b4dabd46d491 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.802621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81abe5-1e3c-4849-803d-b4dabd46d491 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:40.803067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81abe5-1e3c-4849-803d-b4dabd46d491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:40.804961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81abe5-1e3c-4849-803d-b4dabd46d491 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:40.819924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 162/316] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:40.826554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd535944-20c6-4fc9-846b-c50b30b57986 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.839685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd535944-20c6-4fc9-846b-c50b30b57986 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.844572 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3bf7-c994-4ab7-933b-9e3e2bc8403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.845411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3bf7-c994-4ab7-933b-9e3e2bc8403b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.845864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3bf7-c994-4ab7-933b-9e3e2bc8403b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.846304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3bf7-c994-4ab7-933b-9e3e2bc8403b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.858831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c3bf7-c994-4ab7-933b-9e3e2bc8403b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:40.860916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c3bf7-c994-4ab7-933b-9e3e2bc8403b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:40.874196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 155/317] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:40.880414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81abe5-1e3c-4849-803d-b4dabd46d491 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.892080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81abe5-1e3c-4849-803d-b4dabd46d491 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.897791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90a69c-8c93-454e-bdc2-46077bc72e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.899469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90a69c-8c93-454e-bdc2-46077bc72e3a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.899893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90a69c-8c93-454e-bdc2-46077bc72e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.900306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90a69c-8c93-454e-bdc2-46077bc72e3a admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.901810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90a69c-8c93-454e-bdc2-46077bc72e3a admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:40.904173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90a69c-8c93-454e-bdc2-46077bc72e3a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:40.906111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 163/318] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:40 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:40.912783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3bf7-c994-4ab7-933b-9e3e2bc8403b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.922518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3bf7-c994-4ab7-933b-9e3e2bc8403b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.927326 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695c03e-b4a6-48ab-9a85-644fe1842ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.928398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c03e-b4a6-48ab-9a85-644fe1842ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.928819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c03e-b4a6-48ab-9a85-644fe1842ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.929268 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c03e-b4a6-48ab-9a85-644fe1842ad6 admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.931139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695c03e-b4a6-48ab-9a85-644fe1842ad6 admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:40.933494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695c03e-b4a6-48ab-9a85-644fe1842ad6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:40.935291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 156/319] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:40 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:40.941828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90a69c-8c93-454e-bdc2-46077bc72e3a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:40.953826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90a69c-8c93-454e-bdc2-46077bc72e3a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:40.959358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a9432-02e4-4bf8-90fb-3ca9b5596f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:40.960331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a9432-02e4-4bf8-90fb-3ca9b5596f88 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:40.960781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a9432-02e4-4bf8-90fb-3ca9b5596f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:40.961399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a9432-02e4-4bf8-90fb-3ca9b5596f88 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:40.962863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a9432-02e4-4bf8-90fb-3ca9b5596f88 admin admin] RBAC: Adding query filter params (group.id=e92834b95f4d4a3d980f1a0730504803, role.id=70600290909e4c808126b1efb2142b05, scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:40.963347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a9432-02e4-4bf8-90fb-3ca9b5596f88 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:40.965556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a9432-02e4-4bf8-90fb-3ca9b5596f88 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:40.977651 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 164/320] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 04:24:40 2021] GET /identity/v3/role_assignments?group.id=e92834b95f4d4a3d980f1a0730504803&scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6&role.id=70600290909e4c808126b1efb2142b05 => generated 611 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:41.380756 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6549-d98d-44d9-a0fb-8a8596d49052 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:41.381224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6549-d98d-44d9-a0fb-8a8596d49052 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:41.381426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6549-d98d-44d9-a0fb-8a8596d49052 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:41.384280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 157/321] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:41.392428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04751f5-9524-4f7f-8e0e-87e0f2ef4ea3 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:41.392742 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04751f5-9524-4f7f-8e0e-87e0f2ef4ea3 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:41.392993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04751f5-9524-4f7f-8e0e-87e0f2ef4ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:41.411765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a04751f5-9524-4f7f-8e0e-87e0f2ef4ea3 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:41.412996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a04751f5-9524-4f7f-8e0e-87e0f2ef4ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:41.420992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 165/322] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:41.446735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d6549-d98d-44d9-a0fb-8a8596d49052 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:41.459117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d6549-d98d-44d9-a0fb-8a8596d49052 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:41.464111 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157cb2a-ea11-4f6c-8853-dfb9ece851f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:41.464967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157cb2a-ea11-4f6c-8853-dfb9ece851f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:41.465246 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157cb2a-ea11-4f6c-8853-dfb9ece851f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:41.465517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157cb2a-ea11-4f6c-8853-dfb9ece851f7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:41.482345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157cb2a-ea11-4f6c-8853-dfb9ece851f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:41.489501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-f157cb2a-ea11-4f6c-8853-dfb9ece851f7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:41.490886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 158/323] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:41.497160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04751f5-9524-4f7f-8e0e-87e0f2ef4ea3 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:41.506426 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04751f5-9524-4f7f-8e0e-87e0f2ef4ea3 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:41.513851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fdce5-63cf-4582-800b-c7c5f843e5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:41.514537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fdce5-63cf-4582-800b-c7c5f843e5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:41.514812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fdce5-63cf-4582-800b-c7c5f843e5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:41.515085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fdce5-63cf-4582-800b-c7c5f843e5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:41.515846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fdce5-63cf-4582-800b-c7c5f843e5d0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:41.516149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fdce5-63cf-4582-800b-c7c5f843e5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:41.517816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fdce5-63cf-4582-800b-c7c5f843e5d0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:41.527521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 166/324] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:41.533521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157cb2a-ea11-4f6c-8853-dfb9ece851f7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:41.544975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157cb2a-ea11-4f6c-8853-dfb9ece851f7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:41.549469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeac71-15bf-4174-919e-ac22dbe7c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:41.550106 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeac71-15bf-4174-919e-ac22dbe7c39a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:41.550381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeac71-15bf-4174-919e-ac22dbe7c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:41.550654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeac71-15bf-4174-919e-ac22dbe7c39a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:41.561817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aeac71-15bf-4174-919e-ac22dbe7c39a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:41.563586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aeac71-15bf-4174-919e-ac22dbe7c39a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:41.573196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 159/325] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:41.579554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fdce5-63cf-4582-800b-c7c5f843e5d0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:41.589716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fdce5-63cf-4582-800b-c7c5f843e5d0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:41.594711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67a1fc-4093-4d29-9538-7c7d50ef1cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:41.598534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67a1fc-4093-4d29-9538-7c7d50ef1cbd admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:41.598534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67a1fc-4093-4d29-9538-7c7d50ef1cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:41.598534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67a1fc-4093-4d29-9538-7c7d50ef1cbd admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:41.598534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67a1fc-4093-4d29-9538-7c7d50ef1cbd admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:41.599334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67a1fc-4093-4d29-9538-7c7d50ef1cbd admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:41.601044 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 167/326] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:41 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:41.608295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeac71-15bf-4174-919e-ac22dbe7c39a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:41.618750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeac71-15bf-4174-919e-ac22dbe7c39a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:41.623823 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b1a8d-8449-464b-be82-176d788c3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:41.624819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b1a8d-8449-464b-be82-176d788c3f20 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:41.625208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b1a8d-8449-464b-be82-176d788c3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:41.625573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b1a8d-8449-464b-be82-176d788c3f20 admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:41.626872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b1a8d-8449-464b-be82-176d788c3f20 admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:41.629133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b1a8d-8449-464b-be82-176d788c3f20 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:41.631339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 160/327] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:41 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:41.637957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67a1fc-4093-4d29-9538-7c7d50ef1cbd admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:41.648578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67a1fc-4093-4d29-9538-7c7d50ef1cbd admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:41.653402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32011e8-7b6f-45c4-91e5-f5f8c797fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:41.654096 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32011e8-7b6f-45c4-91e5-f5f8c797fea5 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:41.654469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32011e8-7b6f-45c4-91e5-f5f8c797fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:41.654746 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32011e8-7b6f-45c4-91e5-f5f8c797fea5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:41.655583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32011e8-7b6f-45c4-91e5-f5f8c797fea5 admin admin] RBAC: Adding query filter params (group.id=e92834b95f4d4a3d980f1a0730504803, role.id=3df7162472e345bd91ce9469ee6fe3f5, scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:41.655946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32011e8-7b6f-45c4-91e5-f5f8c797fea5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:41.657943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32011e8-7b6f-45c4-91e5-f5f8c797fea5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:41.665858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 168/328] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 04:24:41 2021] GET /identity/v3/role_assignments?group.id=e92834b95f4d4a3d980f1a0730504803&scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6&role.id=3df7162472e345bd91ce9469ee6fe3f5 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:42.393402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cdc55-0c8e-4dbd-80fc-0bffa2cea11e None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.393819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cdc55-0c8e-4dbd-80fc-0bffa2cea11e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.394064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cdc55-0c8e-4dbd-80fc-0bffa2cea11e None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.395754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 161/329] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:42.401967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6083a-c0ac-49f1-8a5c-9043d05c16a2 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.402265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6083a-c0ac-49f1-8a5c-9043d05c16a2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.402546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6083a-c0ac-49f1-8a5c-9043d05c16a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.420642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-1fa6083a-c0ac-49f1-8a5c-9043d05c16a2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:42.421813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1fa6083a-c0ac-49f1-8a5c-9043d05c16a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:42.429451 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 169/330] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:42.453933 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cdc55-0c8e-4dbd-80fc-0bffa2cea11e None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.467162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cdc55-0c8e-4dbd-80fc-0bffa2cea11e None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.471609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcc73a-ddd2-4db9-bb60-841a9b5cac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.472457 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc73a-ddd2-4db9-bb60-841a9b5cac72 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.472739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc73a-ddd2-4db9-bb60-841a9b5cac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.473013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc73a-ddd2-4db9-bb60-841a9b5cac72 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.485459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcc73a-ddd2-4db9-bb60-841a9b5cac72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:42.492648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-48dcc73a-ddd2-4db9-bb60-841a9b5cac72 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:24:42.494834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 162/331] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:42.501571 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6083a-c0ac-49f1-8a5c-9043d05c16a2 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.510620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6083a-c0ac-49f1-8a5c-9043d05c16a2 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.514902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02342a-70a2-45a2-8342-d1147fe2b352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.515565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02342a-70a2-45a2-8342-d1147fe2b352 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.515849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02342a-70a2-45a2-8342-d1147fe2b352 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.516126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02342a-70a2-45a2-8342-d1147fe2b352 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.516920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02342a-70a2-45a2-8342-d1147fe2b352 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:42.517225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02342a-70a2-45a2-8342-d1147fe2b352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:42.518812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02342a-70a2-45a2-8342-d1147fe2b352 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:42.527921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 170/332] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:42.533752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcc73a-ddd2-4db9-bb60-841a9b5cac72 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.538498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f596630-9a71-4a34-8f5d-2e3d2abc8881 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.538786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f596630-9a71-4a34-8f5d-2e3d2abc8881 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.539067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f596630-9a71-4a34-8f5d-2e3d2abc8881 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.541628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 171/333] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:24:42.545209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcc73a-ddd2-4db9-bb60-841a9b5cac72 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.553228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57f43-33db-4aac-b92c-936a6a86ba85 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.553228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57f43-33db-4aac-b92c-936a6a86ba85 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.553228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57f43-33db-4aac-b92c-936a6a86ba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.553504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91039d-7d04-4004-bbe5-be0077b6a32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.553504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91039d-7d04-4004-bbe5-be0077b6a32e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.553504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91039d-7d04-4004-bbe5-be0077b6a32e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.553504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91039d-7d04-4004-bbe5-be0077b6a32e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.560124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91039d-7d04-4004-bbe5-be0077b6a32e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:42.562344 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91039d-7d04-4004-bbe5-be0077b6a32e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:42.567308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-25c57f43-33db-4aac-b92c-936a6a86ba85 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:42.568511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-25c57f43-33db-4aac-b92c-936a6a86ba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:42.576795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 172/334] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:42.576976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 163/335] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:42.578585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c57f43-33db-4aac-b92c-936a6a86ba85 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.590161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c57f43-33db-4aac-b92c-936a6a86ba85 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.594579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e297d-66d2-498c-bf57-73a52c40b6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.595466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e297d-66d2-498c-bf57-73a52c40b6fe admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.595827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e297d-66d2-498c-bf57-73a52c40b6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.596103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e297d-66d2-498c-bf57-73a52c40b6fe admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.597360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e297d-66d2-498c-bf57-73a52c40b6fe admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:42.599417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e297d-66d2-498c-bf57-73a52c40b6fe admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:42.601136 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91039d-7d04-4004-bbe5-be0077b6a32e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.606713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 173/336] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:42.608295 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e297d-66d2-498c-bf57-73a52c40b6fe admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.611474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91039d-7d04-4004-bbe5-be0077b6a32e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.616254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa19dd-0416-43d1-8896-89d1079645fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.617081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa19dd-0416-43d1-8896-89d1079645fb admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.617222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e297d-66d2-498c-bf57-73a52c40b6fe admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.617451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa19dd-0416-43d1-8896-89d1079645fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.617680 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa19dd-0416-43d1-8896-89d1079645fb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.621925 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870d770-8208-463a-9e42-0683989272f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.622789 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870d770-8208-463a-9e42-0683989272f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.623086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870d770-8208-463a-9e42-0683989272f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.623336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870d770-8208-463a-9e42-0683989272f5 admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.624504 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870d770-8208-463a-9e42-0683989272f5 admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:42.626449 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870d770-8208-463a-9e42-0683989272f5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:42.628197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 174/337] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:42.628978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa19dd-0416-43d1-8896-89d1079645fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:42.634499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870d770-8208-463a-9e42-0683989272f5 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.636401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-79aa19dd-0416-43d1-8896-89d1079645fb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:42.637863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 164/338] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:42.643895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870d770-8208-463a-9e42-0683989272f5 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.644210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa19dd-0416-43d1-8896-89d1079645fb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.648241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fe2d3-fe7b-4247-8956-a434f381ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.649412 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fe2d3-fe7b-4247-8956-a434f381ae37 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.649690 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fe2d3-fe7b-4247-8956-a434f381ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.649960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fe2d3-fe7b-4247-8956-a434f381ae37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.650784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fe2d3-fe7b-4247-8956-a434f381ae37 admin admin] RBAC: Adding query filter params (group.id=e92834b95f4d4a3d980f1a0730504803, role.id=70600290909e4c808126b1efb2142b05, scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:42.651090 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fe2d3-fe7b-4247-8956-a434f381ae37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:42.652949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fe2d3-fe7b-4247-8956-a434f381ae37 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:42.657193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa19dd-0416-43d1-8896-89d1079645fb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.658868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 175/339] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/role_assignments?group.id=e92834b95f4d4a3d980f1a0730504803&scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8&role.id=70600290909e4c808126b1efb2142b05 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:42.662785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625621ed-95bc-4aee-99ff-4f9e24001555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.663770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625621ed-95bc-4aee-99ff-4f9e24001555 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.664874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625621ed-95bc-4aee-99ff-4f9e24001555 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.665333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625621ed-95bc-4aee-99ff-4f9e24001555 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.666305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625621ed-95bc-4aee-99ff-4f9e24001555 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:42.666817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625621ed-95bc-4aee-99ff-4f9e24001555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:42.668948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625621ed-95bc-4aee-99ff-4f9e24001555 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:42.682241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 165/340] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:42.689333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fe2d3-fe7b-4247-8956-a434f381ae37 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.700547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fe2d3-fe7b-4247-8956-a434f381ae37 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.705094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97df524-2683-4a29-adf8-151f457de60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.705757 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97df524-2683-4a29-adf8-151f457de60c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.706056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97df524-2683-4a29-adf8-151f457de60c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.706320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97df524-2683-4a29-adf8-151f457de60c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.715687 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97df524-2683-4a29-adf8-151f457de60c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:42.717561 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97df524-2683-4a29-adf8-151f457de60c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:42.733595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 176/341] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:24:42.734850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625621ed-95bc-4aee-99ff-4f9e24001555 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.745504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625621ed-95bc-4aee-99ff-4f9e24001555 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.750339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a978ba-68ab-4756-a1e2-b923c0fb8c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.751278 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a978ba-68ab-4756-a1e2-b923c0fb8c12 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.751623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a978ba-68ab-4756-a1e2-b923c0fb8c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.751963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a978ba-68ab-4756-a1e2-b923c0fb8c12 admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.753371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a978ba-68ab-4756-a1e2-b923c0fb8c12 admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:42.755581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a978ba-68ab-4756-a1e2-b923c0fb8c12 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:42.760389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 166/342] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:42.764133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97df524-2683-4a29-adf8-151f457de60c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.774445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97df524-2683-4a29-adf8-151f457de60c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.779604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff0b56-a0c4-413e-8b5a-b66c806ee40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.780792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff0b56-a0c4-413e-8b5a-b66c806ee40c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.781149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff0b56-a0c4-413e-8b5a-b66c806ee40c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.781439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff0b56-a0c4-413e-8b5a-b66c806ee40c admin admin] PATH_INFO: `/v3/groups/e92834b95f4d4a3d980f1a0730504803` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.782761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff0b56-a0c4-413e-8b5a-b66c806ee40c admin admin] RBAC: Authorizing `identity:get_group(group_id=e92834b95f4d4a3d980f1a0730504803)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:42.784828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff0b56-a0c4-413e-8b5a-b66c806ee40c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:42.787971 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 177/343] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/groups/e92834b95f4d4a3d980f1a0730504803 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:42.794590 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a978ba-68ab-4756-a1e2-b923c0fb8c12 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.804991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a978ba-68ab-4756-a1e2-b923c0fb8c12 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.809960 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630095-91b5-4b76-82d2-ad4cfbcb63c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.810639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630095-91b5-4b76-82d2-ad4cfbcb63c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.810985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630095-91b5-4b76-82d2-ad4cfbcb63c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.811275 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630095-91b5-4b76-82d2-ad4cfbcb63c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.812217 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630095-91b5-4b76-82d2-ad4cfbcb63c9 admin admin] RBAC: Adding query filter params (group.id=e92834b95f4d4a3d980f1a0730504803, role.id=3df7162472e345bd91ce9469ee6fe3f5, scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:42.812573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630095-91b5-4b76-82d2-ad4cfbcb63c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:42.814658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630095-91b5-4b76-82d2-ad4cfbcb63c9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:42.822545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 167/344] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/role_assignments?group.id=e92834b95f4d4a3d980f1a0730504803&scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8&role.id=3df7162472e345bd91ce9469ee6fe3f5 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:42.896764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c184f1-ff56-4640-bf9e-258f0d7c6acf None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.897071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c184f1-ff56-4640-bf9e-258f0d7c6acf None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.897268 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c184f1-ff56-4640-bf9e-258f0d7c6acf None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.900088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 178/345] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:42.906422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ba33-1554-4eb6-bcc1-15247cb3f4fc None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.906713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ba33-1554-4eb6-bcc1-15247cb3f4fc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.906992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ba33-1554-4eb6-bcc1-15247cb3f4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:42.933839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-15d1ba33-1554-4eb6-bcc1-15247cb3f4fc None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:42.935136 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-15d1ba33-1554-4eb6-bcc1-15247cb3f4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:42.944706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 168/346] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:42.970353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c184f1-ff56-4640-bf9e-258f0d7c6acf None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:42.984506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c184f1-ff56-4640-bf9e-258f0d7c6acf None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:42.989137 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46193cc1-079d-4601-9805-b59e25a6a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:42.989942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46193cc1-079d-4601-9805-b59e25a6a965 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:42.990224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46193cc1-079d-4601-9805-b59e25a6a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:42.990495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46193cc1-079d-4601-9805-b59e25a6a965 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:43.002419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46193cc1-079d-4601-9805-b59e25a6a965 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:43.009999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-46193cc1-079d-4601-9805-b59e25a6a965 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:24:43.011256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 179/347] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:43.018078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1ba33-1554-4eb6-bcc1-15247cb3f4fc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:43.028130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1ba33-1554-4eb6-bcc1-15247cb3f4fc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:43.033094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353c618-2f57-4fd7-862a-2153416f1975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:43.033848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353c618-2f57-4fd7-862a-2153416f1975 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:43.034200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353c618-2f57-4fd7-862a-2153416f1975 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:43.034477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353c618-2f57-4fd7-862a-2153416f1975 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:43.035240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353c618-2f57-4fd7-862a-2153416f1975 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:43.035543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353c618-2f57-4fd7-862a-2153416f1975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:43.037272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353c618-2f57-4fd7-862a-2153416f1975 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:43.047147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 169/348] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:43.053974 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46193cc1-079d-4601-9805-b59e25a6a965 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:43.065810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46193cc1-079d-4601-9805-b59e25a6a965 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:43.071122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afdb66-5c4c-4644-8ec6-b12b2783ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:43.071780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afdb66-5c4c-4644-8ec6-b12b2783ad16 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:43.072063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afdb66-5c4c-4644-8ec6-b12b2783ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:43.072342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afdb66-5c4c-4644-8ec6-b12b2783ad16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:43.081028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afdb66-5c4c-4644-8ec6-b12b2783ad16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:43.082957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afdb66-5c4c-4644-8ec6-b12b2783ad16 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:43.093022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 180/349] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:43.099369 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353c618-2f57-4fd7-862a-2153416f1975 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:43.109334 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353c618-2f57-4fd7-862a-2153416f1975 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:43.113832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb419a6d-0de5-45c5-8405-537ba85d6418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:43.114674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb419a6d-0de5-45c5-8405-537ba85d6418 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:43.114990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb419a6d-0de5-45c5-8405-537ba85d6418 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:43.115230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb419a6d-0de5-45c5-8405-537ba85d6418 admin admin] PATH_INFO: `/v3/projects/28c22cecb66d4652809a04ec1798ad5b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:43.116448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb419a6d-0de5-45c5-8405-537ba85d6418 admin admin] RBAC: Authorizing `identity:get_project(project_id=28c22cecb66d4652809a04ec1798ad5b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:43.118285 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb419a6d-0de5-45c5-8405-537ba85d6418 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:43.119950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 170/350] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:24:43 2021] GET /identity/v3/projects/28c22cecb66d4652809a04ec1798ad5b => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:43.126365 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afdb66-5c4c-4644-8ec6-b12b2783ad16 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:43.136028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afdb66-5c4c-4644-8ec6-b12b2783ad16 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:43.140587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ada153-e00c-4fbd-842c-820264b4d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:43.141439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ada153-e00c-4fbd-842c-820264b4d966 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:43.141723 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ada153-e00c-4fbd-842c-820264b4d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:43.142001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ada153-e00c-4fbd-842c-820264b4d966 admin admin] PATH_INFO: `/v3/groups/3f3ad51a3e414508bf408efe9e34e4e7` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:43.143194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ada153-e00c-4fbd-842c-820264b4d966 admin admin] RBAC: Authorizing `identity:get_group(group_id=3f3ad51a3e414508bf408efe9e34e4e7)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:43.145146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ada153-e00c-4fbd-842c-820264b4d966 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:43.146845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 181/351] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 04:24:43 2021] GET /identity/v3/groups/3f3ad51a3e414508bf408efe9e34e4e7 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:43.154028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb419a6d-0de5-45c5-8405-537ba85d6418 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:43.164077 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb419a6d-0de5-45c5-8405-537ba85d6418 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:43.168815 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6414d8-66e2-48c0-8a07-bd1e8aa521dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:43.169451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6414d8-66e2-48c0-8a07-bd1e8aa521dc admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:43.169733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6414d8-66e2-48c0-8a07-bd1e8aa521dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:43.170004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6414d8-66e2-48c0-8a07-bd1e8aa521dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:43.170832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6414d8-66e2-48c0-8a07-bd1e8aa521dc admin admin] RBAC: Adding query filter params (group.id=3f3ad51a3e414508bf408efe9e34e4e7, role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=28c22cecb66d4652809a04ec1798ad5b) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:43.171141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6414d8-66e2-48c0-8a07-bd1e8aa521dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:43.173061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6414d8-66e2-48c0-8a07-bd1e8aa521dc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:43.179219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 171/352] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 04:24:43 2021] GET /identity/v3/role_assignments?group.id=3f3ad51a3e414508bf408efe9e34e4e7&scope.project.id=28c22cecb66d4652809a04ec1798ad5b&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:46.232461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070b5d-752b-4e1c-b0f8-d84ef2b30045 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.233347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070b5d-752b-4e1c-b0f8-d84ef2b30045 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.233784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070b5d-752b-4e1c-b0f8-d84ef2b30045 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.235967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 182/353] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:46.246731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a829da-9bf9-4a8f-aa0c-40ab6cb33e98 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.247633 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a829da-9bf9-4a8f-aa0c-40ab6cb33e98 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.248132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a829da-9bf9-4a8f-aa0c-40ab6cb33e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.272960 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d7a829da-9bf9-4a8f-aa0c-40ab6cb33e98 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:46.275027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d7a829da-9bf9-4a8f-aa0c-40ab6cb33e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:46.287992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 172/354] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:46.318605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61070b5d-752b-4e1c-b0f8-d84ef2b30045 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:46.334310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61070b5d-752b-4e1c-b0f8-d84ef2b30045 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:46.339552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc50614-43c8-4f94-813d-b8b6165b5945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:46.340602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50614-43c8-4f94-813d-b8b6165b5945 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.341085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50614-43c8-4f94-813d-b8b6165b5945 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.341553 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50614-43c8-4f94-813d-b8b6165b5945 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.358008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc50614-43c8-4f94-813d-b8b6165b5945 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:46.360183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc50614-43c8-4f94-813d-b8b6165b5945 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:46.379364 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-9fc50614-43c8-4f94-813d-b8b6165b5945 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:46.380945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 183/355] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:46.387460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a829da-9bf9-4a8f-aa0c-40ab6cb33e98 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:46.397000 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a829da-9bf9-4a8f-aa0c-40ab6cb33e98 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:46.402262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38837749-7958-48bd-a3dc-f778ddf7e4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:46.403151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38837749-7958-48bd-a3dc-f778ddf7e4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.403629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38837749-7958-48bd-a3dc-f778ddf7e4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.404115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38837749-7958-48bd-a3dc-f778ddf7e4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.405080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38837749-7958-48bd-a3dc-f778ddf7e4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:46.405582 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38837749-7958-48bd-a3dc-f778ddf7e4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:46.406852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-38837749-7958-48bd-a3dc-f778ddf7e4b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:46.406852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:46.406852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:46.408109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38837749-7958-48bd-a3dc-f778ddf7e4b0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:46.429526 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 173/356] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:46.435265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc50614-43c8-4f94-813d-b8b6165b5945 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:46.449486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc50614-43c8-4f94-813d-b8b6165b5945 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:46.454348 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ae550-8325-40ff-816d-a110ce71da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:46.455271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ae550-8325-40ff-816d-a110ce71da0d admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.455751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ae550-8325-40ff-816d-a110ce71da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.456231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ae550-8325-40ff-816d-a110ce71da0d admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.457195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ae550-8325-40ff-816d-a110ce71da0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:46.458417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-4d7ae550-8325-40ff-816d-a110ce71da0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:46.458417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:46.458417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:46.459988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ae550-8325-40ff-816d-a110ce71da0d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:46.564829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48363-8ef2-4756-9ded-b02a39982ae3 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.565455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48363-8ef2-4756-9ded-b02a39982ae3 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.566011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48363-8ef2-4756-9ded-b02a39982ae3 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.568652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 174/357] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:24:46.576167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82bf6-03aa-4b6a-94ef-42e15e0097d7 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.576789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82bf6-03aa-4b6a-94ef-42e15e0097d7 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.577243 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82bf6-03aa-4b6a-94ef-42e15e0097d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.603043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 184/358] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:24:46 2021] POST /identity/v3/users => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:46.605189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7ae82bf6-03aa-4b6a-94ef-42e15e0097d7 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:46.608037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7ae82bf6-03aa-4b6a-94ef-42e15e0097d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:46.615537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 175/359] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:46.641656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ae550-8325-40ff-816d-a110ce71da0d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:46.653041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ae550-8325-40ff-816d-a110ce71da0d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:46.657944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549bc5f-a274-4fd8-a49f-9e3fa16678f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:46.658781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549bc5f-a274-4fd8-a49f-9e3fa16678f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.659063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549bc5f-a274-4fd8-a49f-9e3fa16678f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.659341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549bc5f-a274-4fd8-a49f-9e3fa16678f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.672055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549bc5f-a274-4fd8-a49f-9e3fa16678f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:46.673985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549bc5f-a274-4fd8-a49f-9e3fa16678f5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:46.695444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994a61-7800-4c64-9c83-3e6f8ae7b4e6 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.695765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994a61-7800-4c64-9c83-3e6f8ae7b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.696001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994a61-7800-4c64-9c83-3e6f8ae7b4e6 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.702154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-f549bc5f-a274-4fd8-a49f-9e3fa16678f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:46.702806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 176/360] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:46 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:46.703679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 185/361] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:46.709655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a55413-fa4a-4af1-852f-029648c5073a None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.709949 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a55413-fa4a-4af1-852f-029648c5073a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.710212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a55413-fa4a-4af1-852f-029648c5073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.718386 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549bc5f-a274-4fd8-a49f-9e3fa16678f5 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:46.734288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549bc5f-a274-4fd8-a49f-9e3fa16678f5 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:46.741220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-89a55413-fa4a-4af1-852f-029648c5073a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:46.743006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-89a55413-fa4a-4af1-852f-029648c5073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:46.746644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110adfb-57d2-43b6-b594-cf03c42d965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:46.747372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110adfb-57d2-43b6-b594-cf03c42d965c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.747662 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110adfb-57d2-43b6-b594-cf03c42d965c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.747940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110adfb-57d2-43b6-b594-cf03c42d965c admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.748715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110adfb-57d2-43b6-b594-cf03c42d965c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:46.749027 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110adfb-57d2-43b6-b594-cf03c42d965c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:46.750760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110adfb-57d2-43b6-b594-cf03c42d965c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:46.765766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 186/362] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:46.770143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 177/363] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:46.771962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110adfb-57d2-43b6-b594-cf03c42d965c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:46.782176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110adfb-57d2-43b6-b594-cf03c42d965c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:46.795942 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a55413-fa4a-4af1-852f-029648c5073a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:46.796156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac18896-3230-4043-b836-87eb3407114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:46.796860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18896-3230-4043-b836-87eb3407114c admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.797152 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18896-3230-4043-b836-87eb3407114c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.797429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18896-3230-4043-b836-87eb3407114c admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.798156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac18896-3230-4043-b836-87eb3407114c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:46.800278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac18896-3230-4043-b836-87eb3407114c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:46.810450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a55413-fa4a-4af1-852f-029648c5073a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:46.818571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b063e04-938c-4a91-abde-94e91c28ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:46.819392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b063e04-938c-4a91-abde-94e91c28ad9d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.819680 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b063e04-938c-4a91-abde-94e91c28ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.819956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b063e04-938c-4a91-abde-94e91c28ad9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.831555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b063e04-938c-4a91-abde-94e91c28ad9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:46.833606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b063e04-938c-4a91-abde-94e91c28ad9d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:46.853237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-2b063e04-938c-4a91-abde-94e91c28ad9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:46.854767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 178/364] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:46.860717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b063e04-938c-4a91-abde-94e91c28ad9d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:46.871666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b063e04-938c-4a91-abde-94e91c28ad9d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:46.876387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd068c-717a-4cc1-8fdc-3c9449651b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:46.877107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd068c-717a-4cc1-8fdc-3c9449651b1f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.877388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd068c-717a-4cc1-8fdc-3c9449651b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.877660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd068c-717a-4cc1-8fdc-3c9449651b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.878497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd068c-717a-4cc1-8fdc-3c9449651b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:46.878853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd068c-717a-4cc1-8fdc-3c9449651b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:46.880646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd068c-717a-4cc1-8fdc-3c9449651b1f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:46.893918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 179/365] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:46.900033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd068c-717a-4cc1-8fdc-3c9449651b1f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:46.910994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd068c-717a-4cc1-8fdc-3c9449651b1f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:46.917485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3850fa1-a230-469a-a6c2-fdfbda5ff3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:46.918401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3850fa1-a230-469a-a6c2-fdfbda5ff3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.918689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3850fa1-a230-469a-a6c2-fdfbda5ff3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.918967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3850fa1-a230-469a-a6c2-fdfbda5ff3a3 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.919741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3850fa1-a230-469a-a6c2-fdfbda5ff3a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:46.921633 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3850fa1-a230-469a-a6c2-fdfbda5ff3a3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:46.930678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 187/366] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:24:46 2021] POST /identity/v3/users => generated 248 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:47.011089 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 180/367] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:24:46 2021] POST /identity/v3/users => generated 248 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:24:47.047049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550e43-b4fc-4b18-a72a-c06754fa37b0 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:47.047665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550e43-b4fc-4b18-a72a-c06754fa37b0 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:47.048170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550e43-b4fc-4b18-a72a-c06754fa37b0 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:47.050459 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 188/368] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:47.057819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32e48b-405f-4497-abd6-52843213d87d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:47.058169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32e48b-405f-4497-abd6-52843213d87d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:47.058392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32e48b-405f-4497-abd6-52843213d87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:47.203365 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-cd32e48b-405f-4497-abd6-52843213d87d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:47.204655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-cd32e48b-405f-4497-abd6-52843213d87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:47.217392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 181/369] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:47.244063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550e43-b4fc-4b18-a72a-c06754fa37b0 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:47.257964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550e43-b4fc-4b18-a72a-c06754fa37b0 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:47.262806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b267bc4-7716-4580-814e-debde2e1bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:47.263619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267bc4-7716-4580-814e-debde2e1bb98 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:47.263901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267bc4-7716-4580-814e-debde2e1bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:47.264172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267bc4-7716-4580-814e-debde2e1bb98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:47.276959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b267bc4-7716-4580-814e-debde2e1bb98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:47.278840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b267bc4-7716-4580-814e-debde2e1bb98 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:47.298568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-4b267bc4-7716-4580-814e-debde2e1bb98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:47.299800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 189/370] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:47.306955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32e48b-405f-4497-abd6-52843213d87d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:47.319177 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32e48b-405f-4497-abd6-52843213d87d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:47.325225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df972862-cacf-4962-a03e-663a14252f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:47.326118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df972862-cacf-4962-a03e-663a14252f4a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:47.326682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df972862-cacf-4962-a03e-663a14252f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:47.327159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df972862-cacf-4962-a03e-663a14252f4a admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:47.328102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df972862-cacf-4962-a03e-663a14252f4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:47.330376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df972862-cacf-4962-a03e-663a14252f4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:47.332217 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df972862-cacf-4962-a03e-663a14252f4a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:47.349071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 182/371] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:47.355900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b267bc4-7716-4580-814e-debde2e1bb98 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:47.366569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b267bc4-7716-4580-814e-debde2e1bb98 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:47.376301 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc20705-915a-485a-bf43-cab3a3132b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:47.377284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc20705-915a-485a-bf43-cab3a3132b9e admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:47.377744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc20705-915a-485a-bf43-cab3a3132b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:47.378163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc20705-915a-485a-bf43-cab3a3132b9e admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:47.379037 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc20705-915a-485a-bf43-cab3a3132b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:47.381249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc20705-915a-485a-bf43-cab3a3132b9e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:47.469130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 190/372] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:24:47 2021] POST /identity/v3/users => generated 249 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:47.711499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8f85e-3556-46cd-9af5-2f8ac34ae5fd None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:47.711981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8f85e-3556-46cd-9af5-2f8ac34ae5fd None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:47.712509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8f85e-3556-46cd-9af5-2f8ac34ae5fd None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:47.716146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 183/373] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:47 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:24:47.722432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aefa93-7e88-4bf3-b65c-6dd88b6c0b31 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:47.722962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aefa93-7e88-4bf3-b65c-6dd88b6c0b31 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:47.723419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aefa93-7e88-4bf3-b65c-6dd88b6c0b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:47.743148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-08aefa93-7e88-4bf3-b65c-6dd88b6c0b31 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:47.744702 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-08aefa93-7e88-4bf3-b65c-6dd88b6c0b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:47.753804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 191/374] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:47.779360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8f85e-3556-46cd-9af5-2f8ac34ae5fd None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:47.793271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8f85e-3556-46cd-9af5-2f8ac34ae5fd None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:47.798092 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9ed17-e8fc-4ee5-9f54-1bfdba152703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:47.799054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9ed17-e8fc-4ee5-9f54-1bfdba152703 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:47.799522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9ed17-e8fc-4ee5-9f54-1bfdba152703 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:47.800093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9ed17-e8fc-4ee5-9f54-1bfdba152703 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:47.801115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9ed17-e8fc-4ee5-9f54-1bfdba152703 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:47.803228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9ed17-e8fc-4ee5-9f54-1bfdba152703 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:47.863037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.sql.core [None req-a3a9ed17-e8fc-4ee5-9f54-1bfdba152703 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 27 04:24:47.863037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 27 04:24:47.863037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [parameters: {'id': '1ac10db6d67b48419924872a9c4aadcf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 27 04:24:47.863037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73668) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 04:24:47.878357 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-a3a9ed17-e8fc-4ee5-9f54-1bfdba152703 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 27 04:24:47.880059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 184/375] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:24:47 2021] POST /identity/v3/roles => generated 144 bytes in 101 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:47.887391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aefa93-7e88-4bf3-b65c-6dd88b6c0b31 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:47.897114 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aefa93-7e88-4bf3-b65c-6dd88b6c0b31 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:47.906046 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e1a44-863d-42c6-877e-45ed2dfd6a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:47.907125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e1a44-863d-42c6-877e-45ed2dfd6a39 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:47.907587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e1a44-863d-42c6-877e-45ed2dfd6a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:47.908045 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e1a44-863d-42c6-877e-45ed2dfd6a39 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:47.920077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e1a44-863d-42c6-877e-45ed2dfd6a39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:47.932322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-752e1a44-863d-42c6-877e-45ed2dfd6a39 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:24:47.939236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 192/376] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:24:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:47.940440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9ed17-e8fc-4ee5-9f54-1bfdba152703 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:47.959021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9ed17-e8fc-4ee5-9f54-1bfdba152703 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:47.968340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f575f-936a-48f7-9cca-4a689cfb8201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:47.969109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f575f-936a-48f7-9cca-4a689cfb8201 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:47.969399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f575f-936a-48f7-9cca-4a689cfb8201 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:47.969675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f575f-936a-48f7-9cca-4a689cfb8201 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:47.970493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f575f-936a-48f7-9cca-4a689cfb8201 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:47.970865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f575f-936a-48f7-9cca-4a689cfb8201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:47.972668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f575f-936a-48f7-9cca-4a689cfb8201 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:47.992229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 185/377] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:49.715087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51673693-3f6c-49a4-9afc-c6a018e40780 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.716057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51673693-3f6c-49a4-9afc-c6a018e40780 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.716159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12737125-73fe-4099-9e34-f8ff2782d3bf None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.716530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12737125-73fe-4099-9e34-f8ff2782d3bf None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.716759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12737125-73fe-4099-9e34-f8ff2782d3bf None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.717199 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51673693-3f6c-49a4-9afc-c6a018e40780 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.718826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 186/378] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:49.719665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 193/379] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:49.724227 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b1659-c68e-4071-b566-af97c46f96f8 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.724546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b1659-c68e-4071-b566-af97c46f96f8 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.724824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b1659-c68e-4071-b566-af97c46f96f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.729403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d69a6-59dd-4916-959b-4b07364c0ece None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.729688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d69a6-59dd-4916-959b-4b07364c0ece None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.729962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d69a6-59dd-4916-959b-4b07364c0ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.750405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-a60b1659-c68e-4071-b566-af97c46f96f8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:49.752543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a60b1659-c68e-4071-b566-af97c46f96f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:49.756764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a32d69a6-59dd-4916-959b-4b07364c0ece None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:49.758589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a32d69a6-59dd-4916-959b-4b07364c0ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:49.760956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 187/380] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:49.762723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d836d-f9a0-4e2e-b78f-c0c6c62966bf None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.763213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d836d-f9a0-4e2e-b78f-c0c6c62966bf None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.763717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d836d-f9a0-4e2e-b78f-c0c6c62966bf None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.765619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 188/381] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:49.770490 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 194/382] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 27 04:24:49.772388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbfaf1-db37-48ae-b67f-aef221a7ab1e None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.772686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbfaf1-db37-48ae-b67f-aef221a7ab1e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.772963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbfaf1-db37-48ae-b67f-aef221a7ab1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.793498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-42cbfaf1-db37-48ae-b67f-aef221a7ab1e None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:49.795169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-42cbfaf1-db37-48ae-b67f-aef221a7ab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:49.807000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 195/383] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:49.807908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbfaf1-db37-48ae-b67f-aef221a7ab1e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:49.808610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d836d-f9a0-4e2e-b78f-c0c6c62966bf None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:49.825594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbfaf1-db37-48ae-b67f-aef221a7ab1e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:49.827992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d836d-f9a0-4e2e-b78f-c0c6c62966bf None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:49.835482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f435c-018e-4c12-b719-55b3bb996de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:49.836697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403bd9e-397e-4541-adc1-4c9162290357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:49.836930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f435c-018e-4c12-b719-55b3bb996de5 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.837138 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f435c-018e-4c12-b719-55b3bb996de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.837406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f435c-018e-4c12-b719-55b3bb996de5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.838472 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403bd9e-397e-4541-adc1-4c9162290357 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.838961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403bd9e-397e-4541-adc1-4c9162290357 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.839444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403bd9e-397e-4541-adc1-4c9162290357 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.848533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f435c-018e-4c12-b719-55b3bb996de5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:49.850893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403bd9e-397e-4541-adc1-4c9162290357 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:49.855697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-7e3f435c-018e-4c12-b719-55b3bb996de5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:49.856957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 189/384] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:49.857732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f435c-018e-4c12-b719-55b3bb996de5 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:49.858871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-7403bd9e-397e-4541-adc1-4c9162290357 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:49.860473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 196/385] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:49.864312 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403bd9e-397e-4541-adc1-4c9162290357 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:49.873287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f435c-018e-4c12-b719-55b3bb996de5 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:49.874586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403bd9e-397e-4541-adc1-4c9162290357 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:49.879166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9351c-8697-4fcb-b30c-c90803092bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:49.879944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9351c-8697-4fcb-b30c-c90803092bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.880220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9351c-8697-4fcb-b30c-c90803092bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.880514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9351c-8697-4fcb-b30c-c90803092bf7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.884781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2de543-a72c-46dd-9a64-1ee8dda30036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:49.885477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2de543-a72c-46dd-9a64-1ee8dda30036 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.885755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2de543-a72c-46dd-9a64-1ee8dda30036 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.886026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2de543-a72c-46dd-9a64-1ee8dda30036 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.887120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2de543-a72c-46dd-9a64-1ee8dda30036 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:49.887421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2de543-a72c-46dd-9a64-1ee8dda30036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:49.889065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2de543-a72c-46dd-9a64-1ee8dda30036 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:49.896034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9351c-8697-4fcb-b30c-c90803092bf7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:49.899998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 197/386] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:49.904906 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c8e9351c-8697-4fcb-b30c-c90803092bf7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:49.905697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 190/387] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:49.906175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2de543-a72c-46dd-9a64-1ee8dda30036 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:49.906870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9351c-8697-4fcb-b30c-c90803092bf7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:49.918269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2de543-a72c-46dd-9a64-1ee8dda30036 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:49.918989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9351c-8697-4fcb-b30c-c90803092bf7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:49.923210 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6706a-89fe-44c5-9b90-5b996e51f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:49.924197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6706a-89fe-44c5-9b90-5b996e51f4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.924570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6706a-89fe-44c5-9b90-5b996e51f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.924916 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6706a-89fe-44c5-9b90-5b996e51f4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.925828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6706a-89fe-44c5-9b90-5b996e51f4e9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:49.925951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b1b9-1a04-4778-a479-b47ed7cd5c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:49.926207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6706a-89fe-44c5-9b90-5b996e51f4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:49.927088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b1b9-1a04-4778-a479-b47ed7cd5c76 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.927555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b1b9-1a04-4778-a479-b47ed7cd5c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.927996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6706a-89fe-44c5-9b90-5b996e51f4e9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:49.928234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b1b9-1a04-4778-a479-b47ed7cd5c76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.938089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 198/388] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:49.939158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6706a-89fe-44c5-9b90-5b996e51f4e9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:49.942336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4b1b9-1a04-4778-a479-b47ed7cd5c76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:49.944695 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4b1b9-1a04-4778-a479-b47ed7cd5c76 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:49.949263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6706a-89fe-44c5-9b90-5b996e51f4e9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:49.953822 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a646c3-23a3-495a-ba67-56267ef4e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:49.954780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a646c3-23a3-495a-ba67-56267ef4e24e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.954889 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a646c3-23a3-495a-ba67-56267ef4e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.955196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a646c3-23a3-495a-ba67-56267ef4e24e admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.956115 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a646c3-23a3-495a-ba67-56267ef4e24e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:49.956533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a646c3-23a3-495a-ba67-56267ef4e24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:49.958175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a646c3-23a3-495a-ba67-56267ef4e24e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:49.965942 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-e8a4b1b9-1a04-4778-a479-b47ed7cd5c76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:49.967456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 191/389] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:49.967725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 199/390] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:49.968615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b1b9-1a04-4778-a479-b47ed7cd5c76 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:49.974372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a646c3-23a3-495a-ba67-56267ef4e24e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:49.983806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b1b9-1a04-4778-a479-b47ed7cd5c76 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:49.984867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a646c3-23a3-495a-ba67-56267ef4e24e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:49.988881 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1c132-fe0e-442c-8e51-3a353e9178d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:49.989890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1c132-fe0e-442c-8e51-3a353e9178d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.990007 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a712d84-18c9-4c6e-98c3-86f945ab60b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:49.990522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1c132-fe0e-442c-8e51-3a353e9178d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.990702 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a712d84-18c9-4c6e-98c3-86f945ab60b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:49.990957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a712d84-18c9-4c6e-98c3-86f945ab60b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:49.991240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a712d84-18c9-4c6e-98c3-86f945ab60b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:49.991550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1c132-fe0e-442c-8e51-3a353e9178d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.002651 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a712d84-18c9-4c6e-98c3-86f945ab60b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.004227 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1c132-fe0e-442c-8e51-3a353e9178d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.004545 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a712d84-18c9-4c6e-98c3-86f945ab60b7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.006542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1c132-fe0e-442c-8e51-3a353e9178d6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.021362 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-7a712d84-18c9-4c6e-98c3-86f945ab60b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:50.022566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 200/391] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.023938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a712d84-18c9-4c6e-98c3-86f945ab60b7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.024570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-71a1c132-fe0e-442c-8e51-3a353e9178d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:50.025978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 192/392] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.029101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1c132-fe0e-442c-8e51-3a353e9178d6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.034099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a712d84-18c9-4c6e-98c3-86f945ab60b7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.038497 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440e338-2e71-4bb2-84b5-d49a580e03f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.039699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440e338-2e71-4bb2-84b5-d49a580e03f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.039983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440e338-2e71-4bb2-84b5-d49a580e03f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.040261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440e338-2e71-4bb2-84b5-d49a580e03f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.040862 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1c132-fe0e-442c-8e51-3a353e9178d6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.041050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440e338-2e71-4bb2-84b5-d49a580e03f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.041307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440e338-2e71-4bb2-84b5-d49a580e03f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.043407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440e338-2e71-4bb2-84b5-d49a580e03f1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.046508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b2a3b-4231-4ce2-9653-25a215ce61c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.047375 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2a3b-4231-4ce2-9653-25a215ce61c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.047902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2a3b-4231-4ce2-9653-25a215ce61c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.048424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2a3b-4231-4ce2-9653-25a215ce61c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.049385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b2a3b-4231-4ce2-9653-25a215ce61c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.049918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b2a3b-4231-4ce2-9653-25a215ce61c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.051806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b2a3b-4231-4ce2-9653-25a215ce61c8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.061692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 201/393] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.062332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440e338-2e71-4bb2-84b5-d49a580e03f1 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.065426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 193/394] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:50.066550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b2a3b-4231-4ce2-9653-25a215ce61c8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.073029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440e338-2e71-4bb2-84b5-d49a580e03f1 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.076538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b2a3b-4231-4ce2-9653-25a215ce61c8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.077121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ae70a-4051-48f6-9973-0ff1c9090e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.077880 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ae70a-4051-48f6-9973-0ff1c9090e45 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.078184 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ae70a-4051-48f6-9973-0ff1c9090e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.078440 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ae70a-4051-48f6-9973-0ff1c9090e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.079264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ae70a-4051-48f6-9973-0ff1c9090e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.079664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ae70a-4051-48f6-9973-0ff1c9090e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.081679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ae70a-4051-48f6-9973-0ff1c9090e45 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.082755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d9017-29cb-4cc5-b0d0-1ca5dca247b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.083752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9017-29cb-4cc5-b0d0-1ca5dca247b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.084323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9017-29cb-4cc5-b0d0-1ca5dca247b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.084869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9017-29cb-4cc5-b0d0-1ca5dca247b5 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.094740 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 202/395] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.095727 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ae70a-4051-48f6-9973-0ff1c9090e45 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.096591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d9017-29cb-4cc5-b0d0-1ca5dca247b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.099079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d9017-29cb-4cc5-b0d0-1ca5dca247b5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.106981 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ae70a-4051-48f6-9973-0ff1c9090e45 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.112232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a532e9-f2b0-4fa5-a3df-13d648df127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.113135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a532e9-f2b0-4fa5-a3df-13d648df127a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.113504 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a532e9-f2b0-4fa5-a3df-13d648df127a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.113792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a532e9-f2b0-4fa5-a3df-13d648df127a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.117160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c55d9017-29cb-4cc5-b0d0-1ca5dca247b5 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 04:24:50.118802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 194/396] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.119921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d9017-29cb-4cc5-b0d0-1ca5dca247b5 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.128692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a532e9-f2b0-4fa5-a3df-13d648df127a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.130878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a532e9-f2b0-4fa5-a3df-13d648df127a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.135644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d9017-29cb-4cc5-b0d0-1ca5dca247b5 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.140733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75649-0e4d-45fc-8858-06552537c2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.141869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75649-0e4d-45fc-8858-06552537c2ec admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.142347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75649-0e4d-45fc-8858-06552537c2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.142914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75649-0e4d-45fc-8858-06552537c2ec admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.146851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-15a532e9-f2b0-4fa5-a3df-13d648df127a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:24:50.148103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 203/397] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.149505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a532e9-f2b0-4fa5-a3df-13d648df127a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.152926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b75649-0e4d-45fc-8858-06552537c2ec admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.155384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b75649-0e4d-45fc-8858-06552537c2ec admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.159742 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a532e9-f2b0-4fa5-a3df-13d648df127a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.165035 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1ae9-2863-4ba8-a4e3-e4e0c6774550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.165710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1ae9-2863-4ba8-a4e3-e4e0c6774550 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.165984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1ae9-2863-4ba8-a4e3-e4e0c6774550 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.166259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1ae9-2863-4ba8-a4e3-e4e0c6774550 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.167098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1ae9-2863-4ba8-a4e3-e4e0c6774550 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.167402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1ae9-2863-4ba8-a4e3-e4e0c6774550 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.168693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-e0ef1ae9-2863-4ba8-a4e3-e4e0c6774550 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:50.168693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:50.168693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:50.169902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1ae9-2863-4ba8-a4e3-e4e0c6774550 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.174093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-14b75649-0e4d-45fc-8858-06552537c2ec admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:24:50.175578 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 195/398] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.176725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75649-0e4d-45fc-8858-06552537c2ec admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.188229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75649-0e4d-45fc-8858-06552537c2ec admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.193393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf7abe-ea6a-4226-9b1a-2cfefb9453c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.194192 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf7abe-ea6a-4226-9b1a-2cfefb9453c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.194568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf7abe-ea6a-4226-9b1a-2cfefb9453c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.194938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf7abe-ea6a-4226-9b1a-2cfefb9453c2 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.195915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf7abe-ea6a-4226-9b1a-2cfefb9453c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.196335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf7abe-ea6a-4226-9b1a-2cfefb9453c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.197472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-4dcf7abe-ea6a-4226-9b1a-2cfefb9453c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:50.197472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:50.197472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:50.198849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf7abe-ea6a-4226-9b1a-2cfefb9453c2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.212499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 204/399] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.215554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1ae9-2863-4ba8-a4e3-e4e0c6774550 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.231917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1ae9-2863-4ba8-a4e3-e4e0c6774550 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.236504 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c4620-24fc-4877-9680-3f845b08b9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.237334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c4620-24fc-4877-9680-3f845b08b9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.237460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c4620-24fc-4877-9680-3f845b08b9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.237744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c4620-24fc-4877-9680-3f845b08b9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.238595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c4620-24fc-4877-9680-3f845b08b9d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.238906 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c4620-24fc-4877-9680-3f845b08b9d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.240835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c4620-24fc-4877-9680-3f845b08b9d6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.241239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 196/400] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.242873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26895385-270f-4ea0-b4ff-7018ba8daeda None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.243271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26895385-270f-4ea0-b4ff-7018ba8daeda None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.243625 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26895385-270f-4ea0-b4ff-7018ba8daeda None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.245787 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 197/401] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:50.246459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26895385-270f-4ea0-b4ff-7018ba8daeda None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.259940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26895385-270f-4ea0-b4ff-7018ba8daeda None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.264610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b214b8-45bb-4dc3-97e9-1992e3e8c072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.265286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b214b8-45bb-4dc3-97e9-1992e3e8c072 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.265562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b214b8-45bb-4dc3-97e9-1992e3e8c072 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.265830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b214b8-45bb-4dc3-97e9-1992e3e8c072 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.271286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 205/402] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.272405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c4620-24fc-4877-9680-3f845b08b9d6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.277210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b214b8-45bb-4dc3-97e9-1992e3e8c072 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.279070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b214b8-45bb-4dc3-97e9-1992e3e8c072 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.282911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c4620-24fc-4877-9680-3f845b08b9d6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.287718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cdef1-2459-4b7f-8be4-c39fa969596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.288343 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cdef1-2459-4b7f-8be4-c39fa969596a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.288651 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cdef1-2459-4b7f-8be4-c39fa969596a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.289517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cdef1-2459-4b7f-8be4-c39fa969596a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.290651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 198/403] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:50.291964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f28ed-ab42-4779-9fb8-59ec252e4705 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.292260 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f28ed-ab42-4779-9fb8-59ec252e4705 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.292566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f28ed-ab42-4779-9fb8-59ec252e4705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.297942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cdef1-2459-4b7f-8be4-c39fa969596a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.299682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cdef1-2459-4b7f-8be4-c39fa969596a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.308625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 206/404] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:50.309422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cdef1-2459-4b7f-8be4-c39fa969596a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.315696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-302f28ed-ab42-4779-9fb8-59ec252e4705 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:50.317060 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-302f28ed-ab42-4779-9fb8-59ec252e4705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:50.319570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cdef1-2459-4b7f-8be4-c39fa969596a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.324688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c134a8d-5304-44a5-851d-28d0967778e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.325317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 199/405] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:50.325429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c134a8d-5304-44a5-851d-28d0967778e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.325761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c134a8d-5304-44a5-851d-28d0967778e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.326099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c134a8d-5304-44a5-851d-28d0967778e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.333248 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f28ed-ab42-4779-9fb8-59ec252e4705 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.337197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c134a8d-5304-44a5-851d-28d0967778e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.339196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c134a8d-5304-44a5-851d-28d0967778e7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.343293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f28ed-ab42-4779-9fb8-59ec252e4705 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.347794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f1c8-bd35-4e58-82bc-25ee7f7c4609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.348611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f1c8-bd35-4e58-82bc-25ee7f7c4609 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.348892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f1c8-bd35-4e58-82bc-25ee7f7c4609 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.349165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f1c8-bd35-4e58-82bc-25ee7f7c4609 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.349847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 207/406] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:50.350610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c134a8d-5304-44a5-851d-28d0967778e7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.359900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3f1c8-bd35-4e58-82bc-25ee7f7c4609 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.360169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c134a8d-5304-44a5-851d-28d0967778e7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.362260 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3f1c8-bd35-4e58-82bc-25ee7f7c4609 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.365630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39a8a1-2844-4550-b4d5-6d3512de44bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.366532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a8a1-2844-4550-b4d5-6d3512de44bd admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.366910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a8a1-2844-4550-b4d5-6d3512de44bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.367303 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a8a1-2844-4550-b4d5-6d3512de44bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.377943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39a8a1-2844-4550-b4d5-6d3512de44bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.379771 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39a8a1-2844-4550-b4d5-6d3512de44bd admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.380191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-f6e3f1c8-bd35-4e58-82bc-25ee7f7c4609 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:50.381596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 200/407] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.382458 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f1c8-bd35-4e58-82bc-25ee7f7c4609 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.392651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f1c8-bd35-4e58-82bc-25ee7f7c4609 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.397089 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469d46e-33d6-4b4b-9c52-6c498a351990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.397479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-fd39a8a1-2844-4550-b4d5-6d3512de44bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:50.398104 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469d46e-33d6-4b4b-9c52-6c498a351990 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.398990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469d46e-33d6-4b4b-9c52-6c498a351990 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.399279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 208/408] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.399676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469d46e-33d6-4b4b-9c52-6c498a351990 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.401341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39a8a1-2844-4550-b4d5-6d3512de44bd admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.410236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469d46e-33d6-4b4b-9c52-6c498a351990 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:50.411769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39a8a1-2844-4550-b4d5-6d3512de44bd admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.416219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b3a7d-7f49-45eb-872a-4445499b4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.417012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b3a7d-7f49-45eb-872a-4445499b4f42 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.417295 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b3a7d-7f49-45eb-872a-4445499b4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.417571 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b3a7d-7f49-45eb-872a-4445499b4f42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.417658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-9469d46e-33d6-4b4b-9c52-6c498a351990 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:50.424889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 201/409] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.424889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469d46e-33d6-4b4b-9c52-6c498a351990 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.429867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469d46e-33d6-4b4b-9c52-6c498a351990 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.434302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25284d73-021c-4b9f-99d6-f4b688dd5a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.434433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b3a7d-7f49-45eb-872a-4445499b4f42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.435120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25284d73-021c-4b9f-99d6-f4b688dd5a43 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.435493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25284d73-021c-4b9f-99d6-f4b688dd5a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.435861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25284d73-021c-4b9f-99d6-f4b688dd5a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.436256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b3a7d-7f49-45eb-872a-4445499b4f42 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.436784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25284d73-021c-4b9f-99d6-f4b688dd5a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.437179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25284d73-021c-4b9f-99d6-f4b688dd5a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.438870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25284d73-021c-4b9f-99d6-f4b688dd5a43 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.450477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 202/410] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.451274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25284d73-021c-4b9f-99d6-f4b688dd5a43 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.454036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-968b3a7d-7f49-45eb-872a-4445499b4f42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:50.455440 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 209/411] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.456276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b3a7d-7f49-45eb-872a-4445499b4f42 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.465709 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25284d73-021c-4b9f-99d6-f4b688dd5a43 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.470036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397660-7998-4e51-8c4c-9244f76fffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.470678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397660-7998-4e51-8c4c-9244f76fffd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.470965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397660-7998-4e51-8c4c-9244f76fffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.471237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397660-7998-4e51-8c4c-9244f76fffd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.471346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b3a7d-7f49-45eb-872a-4445499b4f42 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.471952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397660-7998-4e51-8c4c-9244f76fffd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.472255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397660-7998-4e51-8c4c-9244f76fffd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.473874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397660-7998-4e51-8c4c-9244f76fffd5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.475856 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c064ee1-4547-487c-97ff-f4a17c448794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.476639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c064ee1-4547-487c-97ff-f4a17c448794 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.476989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c064ee1-4547-487c-97ff-f4a17c448794 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.477332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c064ee1-4547-487c-97ff-f4a17c448794 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.478143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c064ee1-4547-487c-97ff-f4a17c448794 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.478521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c064ee1-4547-487c-97ff-f4a17c448794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.480167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c064ee1-4547-487c-97ff-f4a17c448794 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.486076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 203/412] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.486907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397660-7998-4e51-8c4c-9244f76fffd5 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.498931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 210/413] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.498931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c064ee1-4547-487c-97ff-f4a17c448794 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.501614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397660-7998-4e51-8c4c-9244f76fffd5 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.506755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44385ca4-dc01-4273-96a3-4eb3ec575f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.508155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44385ca4-dc01-4273-96a3-4eb3ec575f3e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.508549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44385ca4-dc01-4273-96a3-4eb3ec575f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.508901 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44385ca4-dc01-4273-96a3-4eb3ec575f3e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.509336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c064ee1-4547-487c-97ff-f4a17c448794 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.513728 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62bb4-cc54-4c3e-8e2e-19b039c1339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.514441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62bb4-cc54-4c3e-8e2e-19b039c1339e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.514787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62bb4-cc54-4c3e-8e2e-19b039c1339e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.515200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62bb4-cc54-4c3e-8e2e-19b039c1339e admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.515915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62bb4-cc54-4c3e-8e2e-19b039c1339e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.516285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62bb4-cc54-4c3e-8e2e-19b039c1339e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.516589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44385ca4-dc01-4273-96a3-4eb3ec575f3e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.518099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62bb4-cc54-4c3e-8e2e-19b039c1339e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.518615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44385ca4-dc01-4273-96a3-4eb3ec575f3e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.530629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 211/414] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.531450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62bb4-cc54-4c3e-8e2e-19b039c1339e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.533070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-44385ca4-dc01-4273-96a3-4eb3ec575f3e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:50.534426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 204/415] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.535098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44385ca4-dc01-4273-96a3-4eb3ec575f3e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.546023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44385ca4-dc01-4273-96a3-4eb3ec575f3e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.548913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62bb4-cc54-4c3e-8e2e-19b039c1339e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.550417 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089f1e0-f996-4d0a-8dbb-5546440bfa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.551179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089f1e0-f996-4d0a-8dbb-5546440bfa6b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.551462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089f1e0-f996-4d0a-8dbb-5546440bfa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.556197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089f1e0-f996-4d0a-8dbb-5546440bfa6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.556304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd60fd-89fa-4120-bbd8-aee8f2df257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.556304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd60fd-89fa-4120-bbd8-aee8f2df257e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.556304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd60fd-89fa-4120-bbd8-aee8f2df257e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.556304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd60fd-89fa-4120-bbd8-aee8f2df257e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.562658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089f1e0-f996-4d0a-8dbb-5546440bfa6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.563370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd60fd-89fa-4120-bbd8-aee8f2df257e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.564596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089f1e0-f996-4d0a-8dbb-5546440bfa6b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.565557 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd60fd-89fa-4120-bbd8-aee8f2df257e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.578478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-7afd60fd-89fa-4120-bbd8-aee8f2df257e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:50.589337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 212/416] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.589337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd60fd-89fa-4120-bbd8-aee8f2df257e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.589558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-b089f1e0-f996-4d0a-8dbb-5546440bfa6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:50.589558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 205/417] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.589558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089f1e0-f996-4d0a-8dbb-5546440bfa6b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.600339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd60fd-89fa-4120-bbd8-aee8f2df257e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.601315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089f1e0-f996-4d0a-8dbb-5546440bfa6b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.605700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd7443-050c-4d69-bdbb-151331faabc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.606222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71987257-4681-4123-897c-7cb9574a658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.606574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd7443-050c-4d69-bdbb-151331faabc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.606957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd7443-050c-4d69-bdbb-151331faabc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.607048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71987257-4681-4123-897c-7cb9574a658f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.607243 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71987257-4681-4123-897c-7cb9574a658f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.607484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd7443-050c-4d69-bdbb-151331faabc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.607570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71987257-4681-4123-897c-7cb9574a658f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.608488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd7443-050c-4d69-bdbb-151331faabc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.608900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd7443-050c-4d69-bdbb-151331faabc9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.610049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-d1dd7443-050c-4d69-bdbb-151331faabc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:50.610049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:24:50.610049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:24:50.611353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd7443-050c-4d69-bdbb-151331faabc9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.614902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71987257-4681-4123-897c-7cb9574a658f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.617139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71987257-4681-4123-897c-7cb9574a658f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.635599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 213/418] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.635771 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-71987257-4681-4123-897c-7cb9574a658f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:50.635860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd7443-050c-4d69-bdbb-151331faabc9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.635965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 206/419] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.635965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71987257-4681-4123-897c-7cb9574a658f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.645743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71987257-4681-4123-897c-7cb9574a658f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.646134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd7443-050c-4d69-bdbb-151331faabc9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.650297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf191-4059-4793-a3b6-e8b45042819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.653581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eab0d3-47ca-44a2-955d-c28ca7dce5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.653712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf191-4059-4793-a3b6-e8b45042819f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.653796 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eab0d3-47ca-44a2-955d-c28ca7dce5bf admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.653876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf191-4059-4793-a3b6-e8b45042819f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.653968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eab0d3-47ca-44a2-955d-c28ca7dce5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.654049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf191-4059-4793-a3b6-e8b45042819f admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.654127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eab0d3-47ca-44a2-955d-c28ca7dce5bf admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.654204 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf191-4059-4793-a3b6-e8b45042819f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.654281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eab0d3-47ca-44a2-955d-c28ca7dce5bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.654367 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf191-4059-4793-a3b6-e8b45042819f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.654446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eab0d3-47ca-44a2-955d-c28ca7dce5bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.654523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-0b8cf191-4059-4793-a3b6-e8b45042819f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:50.654523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:24:50.654523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:24:50.654730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eab0d3-47ca-44a2-955d-c28ca7dce5bf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.655445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf191-4059-4793-a3b6-e8b45042819f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.666706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 214/420] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.667553 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eab0d3-47ca-44a2-955d-c28ca7dce5bf admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.678400 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eab0d3-47ca-44a2-955d-c28ca7dce5bf admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.680222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 207/421] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.681307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf191-4059-4793-a3b6-e8b45042819f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.687756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21f76-d57a-4685-a1c8-d76fd910d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.688441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21f76-d57a-4685-a1c8-d76fd910d6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.688725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21f76-d57a-4685-a1c8-d76fd910d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.689001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21f76-d57a-4685-a1c8-d76fd910d6b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.689961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df21f76-d57a-4685-a1c8-d76fd910d6b2 admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=9f041d8d6b5949c48920b729511f3783) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.690411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df21f76-d57a-4685-a1c8-d76fd910d6b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.693463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf191-4059-4793-a3b6-e8b45042819f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.693582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df21f76-d57a-4685-a1c8-d76fd910d6b2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.703837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cceb51-c660-4256-9251-cd2098f28ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.703837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cceb51-c660-4256-9251-cd2098f28ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.703837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cceb51-c660-4256-9251-cd2098f28ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.703837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cceb51-c660-4256-9251-cd2098f28ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.704339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 215/422] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/role_assignments?user.id=9f041d8d6b5949c48920b729511f3783&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.704339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21f76-d57a-4685-a1c8-d76fd910d6b2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.704631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cceb51-c660-4256-9251-cd2098f28ef7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.704631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cceb51-c660-4256-9251-cd2098f28ef7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.704631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cceb51-c660-4256-9251-cd2098f28ef7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.714483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21f76-d57a-4685-a1c8-d76fd910d6b2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.721557 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6981-03e5-441d-86a4-62067e97eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.722507 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6981-03e5-441d-86a4-62067e97eeda admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.722917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6981-03e5-441d-86a4-62067e97eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.723296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6981-03e5-441d-86a4-62067e97eeda admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.726201 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 208/423] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.728704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cceb51-c660-4256-9251-cd2098f28ef7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.733849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c6981-03e5-441d-86a4-62067e97eeda admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.736494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c6981-03e5-441d-86a4-62067e97eeda admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.743027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cceb51-c660-4256-9251-cd2098f28ef7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.748679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367a54-2207-4cd7-8ccc-bdc21bebfddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.749885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367a54-2207-4cd7-8ccc-bdc21bebfddc admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.750319 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367a54-2207-4cd7-8ccc-bdc21bebfddc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.750744 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367a54-2207-4cd7-8ccc-bdc21bebfddc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.751758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a367a54-2207-4cd7-8ccc-bdc21bebfddc admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=c711b68b32a7435a93b12553972f9f0e) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.752228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a367a54-2207-4cd7-8ccc-bdc21bebfddc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.754433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a367a54-2207-4cd7-8ccc-bdc21bebfddc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.755152 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-e95c6981-03e5-441d-86a4-62067e97eeda admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 04:24:50.760560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 216/424] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/users/neutron => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.761980 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6981-03e5-441d-86a4-62067e97eeda admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.770674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 209/425] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/role_assignments?user.id=c711b68b32a7435a93b12553972f9f0e&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.771744 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367a54-2207-4cd7-8ccc-bdc21bebfddc admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.782927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367a54-2207-4cd7-8ccc-bdc21bebfddc admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.783877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6981-03e5-441d-86a4-62067e97eeda admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.788337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aa1cc-72f2-4234-a2a4-fcd4b6395638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.789362 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aa1cc-72f2-4234-a2a4-fcd4b6395638 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.789807 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aa1cc-72f2-4234-a2a4-fcd4b6395638 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.790186 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aa1cc-72f2-4234-a2a4-fcd4b6395638 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.791220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aa1cc-72f2-4234-a2a4-fcd4b6395638 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.791776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aa1cc-72f2-4234-a2a4-fcd4b6395638 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.792304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b276bc-cfd5-472a-9e2a-7761e6cb0506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.793482 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b276bc-cfd5-472a-9e2a-7761e6cb0506 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.793966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b276bc-cfd5-472a-9e2a-7761e6cb0506 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.794338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aa1cc-72f2-4234-a2a4-fcd4b6395638 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.794649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b276bc-cfd5-472a-9e2a-7761e6cb0506 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.795821 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b276bc-cfd5-472a-9e2a-7761e6cb0506 admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=6812bbce1050419ea721a9b648b87bef) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:50.796333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b276bc-cfd5-472a-9e2a-7761e6cb0506 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.807213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b276bc-cfd5-472a-9e2a-7761e6cb0506 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.813787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 217/426] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/role_assignments?user.id=6812bbce1050419ea721a9b648b87bef&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.817321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 210/427] 10.222.0.25 () {56 vars in 1161 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:50.820405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62399-f1e0-42d5-bf21-856b1797e813 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.820727 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62399-f1e0-42d5-bf21-856b1797e813 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.821016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62399-f1e0-42d5-bf21-856b1797e813 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.823792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aa1cc-72f2-4234-a2a4-fcd4b6395638 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.828073 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 218/428] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:50.829804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdaadd-6cad-4692-b938-60256a7b5072 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.830093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdaadd-6cad-4692-b938-60256a7b5072 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.830372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdaadd-6cad-4692-b938-60256a7b5072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.835674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aa1cc-72f2-4234-a2a4-fcd4b6395638 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.855609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391154f-ce6e-4096-bf60-9208b9c33487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.856290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391154f-ce6e-4096-bf60-9208b9c33487 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.856608 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391154f-ce6e-4096-bf60-9208b9c33487 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.856890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391154f-ce6e-4096-bf60-9208b9c33487 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.858724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-9fcdaadd-6cad-4692-b938-60256a7b5072 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:50.860068 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9fcdaadd-6cad-4692-b938-60256a7b5072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:50.879854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 219/429] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:50.893460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391154f-ce6e-4096-bf60-9208b9c33487 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.895440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391154f-ce6e-4096-bf60-9208b9c33487 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.911621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 211/430] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:50.919093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdaadd-6cad-4692-b938-60256a7b5072 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.920763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391154f-ce6e-4096-bf60-9208b9c33487 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.932224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391154f-ce6e-4096-bf60-9208b9c33487 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.936294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdaadd-6cad-4692-b938-60256a7b5072 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:50.937313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a566f7-448e-460f-9de5-a774c6121b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.938123 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a566f7-448e-460f-9de5-a774c6121b10 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.938408 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a566f7-448e-460f-9de5-a774c6121b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.938683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a566f7-448e-460f-9de5-a774c6121b10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.940951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9f959-8b1d-4a23-ad46-ecc857463761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:50.942009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9f959-8b1d-4a23-ad46-ecc857463761 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:50.942009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9f959-8b1d-4a23-ad46-ecc857463761 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:50.942285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9f959-8b1d-4a23-ad46-ecc857463761 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:50.953626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a566f7-448e-460f-9de5-a774c6121b10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.955636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a566f7-448e-460f-9de5-a774c6121b10 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.963967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9f959-8b1d-4a23-ad46-ecc857463761 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:50.965982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9f959-8b1d-4a23-ad46-ecc857463761 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:50.976950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c9a566f7-448e-460f-9de5-a774c6121b10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:50.978495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 212/431] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:50.985898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a566f7-448e-460f-9de5-a774c6121b10 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:50.997640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a566f7-448e-460f-9de5-a774c6121b10 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:51.000172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-dda9f959-8b1d-4a23-ad46-ecc857463761 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:51.001811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 220/432] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:51.002543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be1c4-0bd1-4eff-9d5b-28eb97ba5fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:51.003278 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be1c4-0bd1-4eff-9d5b-28eb97ba5fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:51.003563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be1c4-0bd1-4eff-9d5b-28eb97ba5fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:51.003863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be1c4-0bd1-4eff-9d5b-28eb97ba5fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:51.004615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be1c4-0bd1-4eff-9d5b-28eb97ba5fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:51.004937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be1c4-0bd1-4eff-9d5b-28eb97ba5fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:51.007272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be1c4-0bd1-4eff-9d5b-28eb97ba5fc0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:51.009939 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9f959-8b1d-4a23-ad46-ecc857463761 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:51.022324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 213/433] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:51.028825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be1c4-0bd1-4eff-9d5b-28eb97ba5fc0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:51.030505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9f959-8b1d-4a23-ad46-ecc857463761 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:51.036225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a32be9-00da-49f9-b014-1ccedc0153a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:51.037495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32be9-00da-49f9-b014-1ccedc0153a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:51.038071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32be9-00da-49f9-b014-1ccedc0153a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:51.038563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32be9-00da-49f9-b014-1ccedc0153a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:51.038939 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be1c4-0bd1-4eff-9d5b-28eb97ba5fc0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:51.039833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a32be9-00da-49f9-b014-1ccedc0153a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:51.040336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a32be9-00da-49f9-b014-1ccedc0153a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:51.042387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a32be9-00da-49f9-b014-1ccedc0153a3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:51.043723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b417e-eb7c-492b-87c3-553ca2e0bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:51.044396 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b417e-eb7c-492b-87c3-553ca2e0bf9c admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:51.044685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b417e-eb7c-492b-87c3-553ca2e0bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:51.044964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b417e-eb7c-492b-87c3-553ca2e0bf9c admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:51.045669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b417e-eb7c-492b-87c3-553ca2e0bf9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:51.047608 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b417e-eb7c-492b-87c3-553ca2e0bf9c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:51.058524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 221/434] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:51.064406 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a32be9-00da-49f9-b014-1ccedc0153a3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:51.075598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a32be9-00da-49f9-b014-1ccedc0153a3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:51.080929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe114-0d60-497b-a9e3-5d27a6bbf140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:51.082078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe114-0d60-497b-a9e3-5d27a6bbf140 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:51.082593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe114-0d60-497b-a9e3-5d27a6bbf140 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:51.083077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe114-0d60-497b-a9e3-5d27a6bbf140 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:51.091366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fe114-0d60-497b-a9e3-5d27a6bbf140 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:51.093659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fe114-0d60-497b-a9e3-5d27a6bbf140 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:51.111009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-bd1fe114-0d60-497b-a9e3-5d27a6bbf140 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:51.112940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 222/435] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:51.119155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe114-0d60-497b-a9e3-5d27a6bbf140 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:51.128250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 214/436] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:24:51 2021] POST /identity/v3/users => generated 247 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:24:51.131207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe114-0d60-497b-a9e3-5d27a6bbf140 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:51.145463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbec43e-1235-4e95-ada6-9038175461f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:51.146510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbec43e-1235-4e95-ada6-9038175461f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:51.146958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbec43e-1235-4e95-ada6-9038175461f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:51.147487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbec43e-1235-4e95-ada6-9038175461f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:51.148867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbec43e-1235-4e95-ada6-9038175461f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:51.155892 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbec43e-1235-4e95-ada6-9038175461f3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:51.155892 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbec43e-1235-4e95-ada6-9038175461f3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:51.168731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 223/437] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:51.177523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b417e-eb7c-492b-87c3-553ca2e0bf9c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:51.199083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b417e-eb7c-492b-87c3-553ca2e0bf9c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:51.203644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bdfac-b60f-40fe-8b29-4c82eeb67c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:51.204304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bdfac-b60f-40fe-8b29-4c82eeb67c27 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:51.204721 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bdfac-b60f-40fe-8b29-4c82eeb67c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:51.204892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bdfac-b60f-40fe-8b29-4c82eeb67c27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:51.206312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bdfac-b60f-40fe-8b29-4c82eeb67c27 admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=a95d2eadd8c7455bb70477e4522c74c3) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:51.206856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bdfac-b60f-40fe-8b29-4c82eeb67c27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:51.214611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bdfac-b60f-40fe-8b29-4c82eeb67c27 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:51.224710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 215/438] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:51 2021] GET /identity/v3/role_assignments?user.id=a95d2eadd8c7455bb70477e4522c74c3&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:53.384657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92438-c898-4510-a8af-077185506dad None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.385171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92438-c898-4510-a8af-077185506dad None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.385271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92438-c898-4510-a8af-077185506dad None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.387212 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 224/439] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:53.393682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a422-169a-4352-89a9-5cfc5d54065f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.394146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a422-169a-4352-89a9-5cfc5d54065f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.394221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a422-169a-4352-89a9-5cfc5d54065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.411578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2905088-da38-4646-91f1-67e08fc5b589 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.411881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2905088-da38-4646-91f1-67e08fc5b589 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.412146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2905088-da38-4646-91f1-67e08fc5b589 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.415002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 225/440] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:53.421283 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc2e8e-e90d-43de-acc7-aca82845bc1b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.421567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc2e8e-e90d-43de-acc7-aca82845bc1b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.421847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc2e8e-e90d-43de-acc7-aca82845bc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.421963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b050a422-169a-4352-89a9-5cfc5d54065f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:53.423156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b050a422-169a-4352-89a9-5cfc5d54065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:53.435863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 216/441] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:53.440394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-61fc2e8e-e90d-43de-acc7-aca82845bc1b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:53.441618 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-61fc2e8e-e90d-43de-acc7-aca82845bc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:53.450106 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 226/442] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:53.467395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050a422-169a-4352-89a9-5cfc5d54065f None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.474054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc2e8e-e90d-43de-acc7-aca82845bc1b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.481907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050a422-169a-4352-89a9-5cfc5d54065f None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.486561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b25930-8409-43b3-86be-40b1e53ec794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.487374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b25930-8409-43b3-86be-40b1e53ec794 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.487658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b25930-8409-43b3-86be-40b1e53ec794 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.487934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b25930-8409-43b3-86be-40b1e53ec794 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.488092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc2e8e-e90d-43de-acc7-aca82845bc1b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.497616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382f52-a72b-466a-bf2b-274eac1c4397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.498428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382f52-a72b-466a-bf2b-274eac1c4397 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.498713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382f52-a72b-466a-bf2b-274eac1c4397 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.498991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382f52-a72b-466a-bf2b-274eac1c4397 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.510841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b25930-8409-43b3-86be-40b1e53ec794 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:53.517928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-06b25930-8409-43b3-86be-40b1e53ec794 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:53.519191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 217/443] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:53.526288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b25930-8409-43b3-86be-40b1e53ec794 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.527932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87382f52-a72b-466a-bf2b-274eac1c4397 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:53.534940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-87382f52-a72b-466a-bf2b-274eac1c4397 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:53.536421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 227/444] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:53.545198 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382f52-a72b-466a-bf2b-274eac1c4397 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.555146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b25930-8409-43b3-86be-40b1e53ec794 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.559108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382f52-a72b-466a-bf2b-274eac1c4397 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.561055 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1782-5fe8-4e1d-aa07-cea6c8564964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.561731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1782-5fe8-4e1d-aa07-cea6c8564964 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.562033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1782-5fe8-4e1d-aa07-cea6c8564964 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.562275 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1782-5fe8-4e1d-aa07-cea6c8564964 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.563036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d1782-5fe8-4e1d-aa07-cea6c8564964 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:53.563339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d1782-5fe8-4e1d-aa07-cea6c8564964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.565006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d1782-5fe8-4e1d-aa07-cea6c8564964 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.565414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8217b-d55e-4832-9ac9-e988a8e61a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.566328 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8217b-d55e-4832-9ac9-e988a8e61a7c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.567019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8217b-d55e-4832-9ac9-e988a8e61a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.567499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8217b-d55e-4832-9ac9-e988a8e61a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.568476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8217b-d55e-4832-9ac9-e988a8e61a7c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:53.568984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8217b-d55e-4832-9ac9-e988a8e61a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.571314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8217b-d55e-4832-9ac9-e988a8e61a7c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.584661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 218/445] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:53.587120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 228/446] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:53.593067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1782-5fe8-4e1d-aa07-cea6c8564964 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.594393 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8217b-d55e-4832-9ac9-e988a8e61a7c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.606525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1782-5fe8-4e1d-aa07-cea6c8564964 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.606909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8217b-d55e-4832-9ac9-e988a8e61a7c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.610984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f49caf-0025-4099-adb0-d65923c51965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.611622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6285b-d0e2-47b8-bcdb-d1e851266d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.611766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f49caf-0025-4099-adb0-d65923c51965 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.612109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f49caf-0025-4099-adb0-d65923c51965 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.612418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f49caf-0025-4099-adb0-d65923c51965 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.612521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6285b-d0e2-47b8-bcdb-d1e851266d19 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.612745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6285b-d0e2-47b8-bcdb-d1e851266d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.613017 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6285b-d0e2-47b8-bcdb-d1e851266d19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.624023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f49caf-0025-4099-adb0-d65923c51965 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.624518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6285b-d0e2-47b8-bcdb-d1e851266d19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.626303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f49caf-0025-4099-adb0-d65923c51965 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.626414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6285b-d0e2-47b8-bcdb-d1e851266d19 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.644509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-e6b6285b-d0e2-47b8-bcdb-d1e851266d19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:53.645539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-e8f49caf-0025-4099-adb0-d65923c51965 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:53.645653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 229/447] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:53.647010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 219/448] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:53.649227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379229a-83c7-4024-bfe6-d5ddecf3195f None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.649859 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379229a-83c7-4024-bfe6-d5ddecf3195f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.650352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379229a-83c7-4024-bfe6-d5ddecf3195f None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.653333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f49caf-0025-4099-adb0-d65923c51965 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.654213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 230/449] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:53 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:53.655491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379229a-83c7-4024-bfe6-d5ddecf3195f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.666941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f49caf-0025-4099-adb0-d65923c51965 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.671749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3e342-713b-4757-a137-eb9db8ef31f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.672676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3e342-713b-4757-a137-eb9db8ef31f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.672960 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3e342-713b-4757-a137-eb9db8ef31f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.673242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3e342-713b-4757-a137-eb9db8ef31f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.673980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3e342-713b-4757-a137-eb9db8ef31f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:53.674286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3e342-713b-4757-a137-eb9db8ef31f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.678429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3e342-713b-4757-a137-eb9db8ef31f2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.687502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379229a-83c7-4024-bfe6-d5ddecf3195f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.690469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 220/450] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:53.693825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2541c-c506-473d-b63e-826b04597323 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.693825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2541c-c506-473d-b63e-826b04597323 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.693825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2541c-c506-473d-b63e-826b04597323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.699301 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c561-9a3d-455f-b9f1-ee5abcbfad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.699975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c561-9a3d-455f-b9f1-ee5abcbfad24 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.700259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c561-9a3d-455f-b9f1-ee5abcbfad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.700560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c561-9a3d-455f-b9f1-ee5abcbfad24 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.701296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45c561-9a3d-455f-b9f1-ee5abcbfad24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:53.701608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45c561-9a3d-455f-b9f1-ee5abcbfad24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.703219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45c561-9a3d-455f-b9f1-ee5abcbfad24 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.716641 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 231/451] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:53.721805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c561-9a3d-455f-b9f1-ee5abcbfad24 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.723669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-5bc2541c-c506-473d-b63e-826b04597323 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:53.725032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5bc2541c-c506-473d-b63e-826b04597323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:53.734186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c561-9a3d-455f-b9f1-ee5abcbfad24 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.739987 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 221/452] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:53.739987 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2541c-c506-473d-b63e-826b04597323 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.747105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2541c-c506-473d-b63e-826b04597323 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.749112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263c413-3eb6-4c5e-833f-fdbbca8749ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.750220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263c413-3eb6-4c5e-833f-fdbbca8749ad admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.750788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263c413-3eb6-4c5e-833f-fdbbca8749ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.751209 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263c413-3eb6-4c5e-833f-fdbbca8749ad admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.751917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda79a2b-5d84-4015-bad1-2ca818450693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.755490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79a2b-5d84-4015-bad1-2ca818450693 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.755490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79a2b-5d84-4015-bad1-2ca818450693 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.755490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79a2b-5d84-4015-bad1-2ca818450693 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.763205 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda79a2b-5d84-4015-bad1-2ca818450693 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.765515 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda79a2b-5d84-4015-bad1-2ca818450693 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.771034 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263c413-3eb6-4c5e-833f-fdbbca8749ad admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.778053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263c413-3eb6-4c5e-833f-fdbbca8749ad admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.787379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-dda79a2b-5d84-4015-bad1-2ca818450693 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:24:53.788676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 222/453] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:53.790441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda79a2b-5d84-4015-bad1-2ca818450693 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.800249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-5263c413-3eb6-4c5e-833f-fdbbca8749ad admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:24:53.800538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda79a2b-5d84-4015-bad1-2ca818450693 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.802363 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 232/454] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/users/nova => generated 82 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:53.803458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263c413-3eb6-4c5e-833f-fdbbca8749ad admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.805976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50646163-fa66-4891-9e9f-ed8ff23e2722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.806870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50646163-fa66-4891-9e9f-ed8ff23e2722 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.807259 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50646163-fa66-4891-9e9f-ed8ff23e2722 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.807638 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50646163-fa66-4891-9e9f-ed8ff23e2722 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.814819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263c413-3eb6-4c5e-833f-fdbbca8749ad admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.819575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acead958-6967-4538-8cd5-0e7ff8cecf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.820855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acead958-6967-4538-8cd5-0e7ff8cecf16 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.821142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acead958-6967-4538-8cd5-0e7ff8cecf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.821418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acead958-6967-4538-8cd5-0e7ff8cecf16 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.821517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50646163-fa66-4891-9e9f-ed8ff23e2722 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:53.822245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acead958-6967-4538-8cd5-0e7ff8cecf16 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:53.822550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acead958-6967-4538-8cd5-0e7ff8cecf16 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.824417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acead958-6967-4538-8cd5-0e7ff8cecf16 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.829500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-50646163-fa66-4891-9e9f-ed8ff23e2722 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:53.831650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 223/455] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:53.832098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50646163-fa66-4891-9e9f-ed8ff23e2722 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.842818 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 233/456] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:53.843907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50646163-fa66-4891-9e9f-ed8ff23e2722 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.845494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d5a2c-82a0-47c6-bfcf-b589d9315afb None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.845854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d5a2c-82a0-47c6-bfcf-b589d9315afb None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.846197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d5a2c-82a0-47c6-bfcf-b589d9315afb None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.848046 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 234/457] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:53.848775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d5a2c-82a0-47c6-bfcf-b589d9315afb None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.851765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eebdea-1ec8-4b0e-85f5-ceecd09eb369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.852686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eebdea-1ec8-4b0e-85f5-ceecd09eb369 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.853141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eebdea-1ec8-4b0e-85f5-ceecd09eb369 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.853597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eebdea-1ec8-4b0e-85f5-ceecd09eb369 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.854452 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eebdea-1ec8-4b0e-85f5-ceecd09eb369 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:53.854763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eebdea-1ec8-4b0e-85f5-ceecd09eb369 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.856675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eebdea-1ec8-4b0e-85f5-ceecd09eb369 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.860879 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d5a2c-82a0-47c6-bfcf-b589d9315afb None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.865401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481434b2-72f7-404e-a29e-0b5e6986cbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.866106 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481434b2-72f7-404e-a29e-0b5e6986cbed admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.866394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481434b2-72f7-404e-a29e-0b5e6986cbed admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.866691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481434b2-72f7-404e-a29e-0b5e6986cbed admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.868313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481434b2-72f7-404e-a29e-0b5e6986cbed admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:53.868664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481434b2-72f7-404e-a29e-0b5e6986cbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.870246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481434b2-72f7-404e-a29e-0b5e6986cbed admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.875706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 224/458] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:53.876585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eebdea-1ec8-4b0e-85f5-ceecd09eb369 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.879679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 235/459] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:53.881346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7c896-94da-4bff-831a-9ca508d37a91 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.881977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7c896-94da-4bff-831a-9ca508d37a91 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.882560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7c896-94da-4bff-831a-9ca508d37a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.886517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eebdea-1ec8-4b0e-85f5-ceecd09eb369 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.891174 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38339b83-1a8b-470f-8dac-b1710f348069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.891717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38339b83-1a8b-470f-8dac-b1710f348069 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.892001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38339b83-1a8b-470f-8dac-b1710f348069 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.892278 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38339b83-1a8b-470f-8dac-b1710f348069 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.901598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a0f7c896-94da-4bff-831a-9ca508d37a91 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:53.902716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a0f7c896-94da-4bff-831a-9ca508d37a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:53.903018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38339b83-1a8b-470f-8dac-b1710f348069 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.904957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38339b83-1a8b-470f-8dac-b1710f348069 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.910452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 236/460] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:53.916229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7c896-94da-4bff-831a-9ca508d37a91 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.923094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-38339b83-1a8b-470f-8dac-b1710f348069 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:53.924400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 225/461] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:53.925358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38339b83-1a8b-470f-8dac-b1710f348069 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.927197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7c896-94da-4bff-831a-9ca508d37a91 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.932552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1751f-87f5-4bd4-be2f-5878b259ac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.933851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1751f-87f5-4bd4-be2f-5878b259ac12 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.934356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1751f-87f5-4bd4-be2f-5878b259ac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.934822 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1751f-87f5-4bd4-be2f-5878b259ac12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.935193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38339b83-1a8b-470f-8dac-b1710f348069 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.940165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2951129-7b74-4bd9-ab71-6d2a62be6067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.940962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2951129-7b74-4bd9-ab71-6d2a62be6067 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.941248 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2951129-7b74-4bd9-ab71-6d2a62be6067 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.941525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2951129-7b74-4bd9-ab71-6d2a62be6067 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.947927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1751f-87f5-4bd4-be2f-5878b259ac12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.949827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1751f-87f5-4bd4-be2f-5878b259ac12 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.952219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2951129-7b74-4bd9-ab71-6d2a62be6067 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.954148 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2951129-7b74-4bd9-ab71-6d2a62be6067 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:53.969134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-23b1751f-87f5-4bd4-be2f-5878b259ac12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:53.975399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 237/462] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:53.975399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1751f-87f5-4bd4-be2f-5878b259ac12 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.975573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-a2951129-7b74-4bd9-ab71-6d2a62be6067 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:53.975573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 226/463] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:53.975808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2951129-7b74-4bd9-ab71-6d2a62be6067 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:53.986021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2951129-7b74-4bd9-ab71-6d2a62be6067 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.986330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1751f-87f5-4bd4-be2f-5878b259ac12 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:53.990699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741f045-944d-4a11-bb4a-491e8b2ee3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.990822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b9670-420a-4502-9470-dbc0acde2e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:53.991342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741f045-944d-4a11-bb4a-491e8b2ee3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.991516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9670-420a-4502-9470-dbc0acde2e79 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:53.991665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741f045-944d-4a11-bb4a-491e8b2ee3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.991819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9670-420a-4502-9470-dbc0acde2e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:53.991940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741f045-944d-4a11-bb4a-491e8b2ee3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.992141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9670-420a-4502-9470-dbc0acde2e79 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:53.992675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741f045-944d-4a11-bb4a-491e8b2ee3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:53.992984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741f045-944d-4a11-bb4a-491e8b2ee3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:53.994574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741f045-944d-4a11-bb4a-491e8b2ee3c7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.003866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b9670-420a-4502-9470-dbc0acde2e79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:54.010954 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 238/464] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.010954 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741f045-944d-4a11-bb4a-491e8b2ee3c7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.011169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-4c7b9670-420a-4502-9470-dbc0acde2e79 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:54.013374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 227/465] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.013374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b9670-420a-4502-9470-dbc0acde2e79 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.020243 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741f045-944d-4a11-bb4a-491e8b2ee3c7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.025844 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f15ae-c3b5-40bf-9e86-1418af399dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.026492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f15ae-c3b5-40bf-9e86-1418af399dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.026771 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f15ae-c3b5-40bf-9e86-1418af399dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.027040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f15ae-c3b5-40bf-9e86-1418af399dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.027586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b9670-420a-4502-9470-dbc0acde2e79 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.027772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f15ae-c3b5-40bf-9e86-1418af399dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.028043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f15ae-c3b5-40bf-9e86-1418af399dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.029780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f15ae-c3b5-40bf-9e86-1418af399dc1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.032366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dd459-659e-4b4a-9422-884cea155ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.032629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd459-659e-4b4a-9422-884cea155ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.032912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd459-659e-4b4a-9422-884cea155ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.033191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd459-659e-4b4a-9422-884cea155ec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.033910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dd459-659e-4b4a-9422-884cea155ec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.034218 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dd459-659e-4b4a-9422-884cea155ec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.035806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dd459-659e-4b4a-9422-884cea155ec6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.041913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 239/466] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.045725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f15ae-c3b5-40bf-9e86-1418af399dc1 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.053306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 228/467] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.053306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dd459-659e-4b4a-9422-884cea155ec6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.059380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dd459-659e-4b4a-9422-884cea155ec6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.060626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f15ae-c3b5-40bf-9e86-1418af399dc1 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.063976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc2aad-18f2-46f1-85fe-15a8a6352b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.064649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc2aad-18f2-46f1-85fe-15a8a6352b8f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.064931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc2aad-18f2-46f1-85fe-15a8a6352b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.065206 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc2aad-18f2-46f1-85fe-15a8a6352b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.065392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be925b4-af2f-4cdf-81de-330ae5063a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.065956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc2aad-18f2-46f1-85fe-15a8a6352b8f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.066154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be925b4-af2f-4cdf-81de-330ae5063a4e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.066246 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc2aad-18f2-46f1-85fe-15a8a6352b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.066437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be925b4-af2f-4cdf-81de-330ae5063a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.066705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be925b4-af2f-4cdf-81de-330ae5063a4e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.067860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc2aad-18f2-46f1-85fe-15a8a6352b8f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.074222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be925b4-af2f-4cdf-81de-330ae5063a4e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.076169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be925b4-af2f-4cdf-81de-330ae5063a4e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.077014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 229/468] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.077673 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc2aad-18f2-46f1-85fe-15a8a6352b8f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.087490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc2aad-18f2-46f1-85fe-15a8a6352b8f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.092191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4e69e-0749-4fd6-a12b-ebfc76f1f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.094048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4e69e-0749-4fd6-a12b-ebfc76f1f4da admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.094048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4e69e-0749-4fd6-a12b-ebfc76f1f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.094048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4e69e-0749-4fd6-a12b-ebfc76f1f4da admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.095720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-9be925b4-af2f-4cdf-81de-330ae5063a4e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:54.097040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 240/469] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.097860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be925b4-af2f-4cdf-81de-330ae5063a4e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.102802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4e69e-0749-4fd6-a12b-ebfc76f1f4da admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.105184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4e69e-0749-4fd6-a12b-ebfc76f1f4da admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.114338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be925b4-af2f-4cdf-81de-330ae5063a4e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.120454 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-83c4e69e-0749-4fd6-a12b-ebfc76f1f4da admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:54.120653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf4118-29ee-4818-8cd7-318c3d20e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.121451 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4118-29ee-4818-8cd7-318c3d20e252 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.121731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4118-29ee-4818-8cd7-318c3d20e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.122006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4118-29ee-4818-8cd7-318c3d20e252 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.127226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 230/470] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.128163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4e69e-0749-4fd6-a12b-ebfc76f1f4da admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.130061 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf4118-29ee-4818-8cd7-318c3d20e252 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.132094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf4118-29ee-4818-8cd7-318c3d20e252 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.138206 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4e69e-0749-4fd6-a12b-ebfc76f1f4da admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.142497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411da649-dd8a-4ca6-aede-e2c85eb42ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.143311 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da649-dd8a-4ca6-aede-e2c85eb42ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.143594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da649-dd8a-4ca6-aede-e2c85eb42ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.143866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da649-dd8a-4ca6-aede-e2c85eb42ba0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.146051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-bebf4118-29ee-4818-8cd7-318c3d20e252 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 04:24:54.152761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 241/471] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.152761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf4118-29ee-4818-8cd7-318c3d20e252 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.156343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411da649-dd8a-4ca6-aede-e2c85eb42ba0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.158258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411da649-dd8a-4ca6-aede-e2c85eb42ba0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.162826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf4118-29ee-4818-8cd7-318c3d20e252 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.167831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6174a5-e833-48b2-93b5-27917dba65f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.168768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6174a5-e833-48b2-93b5-27917dba65f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.169052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6174a5-e833-48b2-93b5-27917dba65f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.169326 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6174a5-e833-48b2-93b5-27917dba65f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.170106 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6174a5-e833-48b2-93b5-27917dba65f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.170422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6174a5-e833-48b2-93b5-27917dba65f9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.172262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6174a5-e833-48b2-93b5-27917dba65f9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.175644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-411da649-dd8a-4ca6-aede-e2c85eb42ba0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:54.176889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 231/472] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.177656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411da649-dd8a-4ca6-aede-e2c85eb42ba0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.189508 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 242/473] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.189508 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6174a5-e833-48b2-93b5-27917dba65f9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.189738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411da649-dd8a-4ca6-aede-e2c85eb42ba0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.192749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f7cec-e6df-40b8-a238-4f72e3beb610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.193361 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f7cec-e6df-40b8-a238-4f72e3beb610 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.193639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f7cec-e6df-40b8-a238-4f72e3beb610 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.193913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f7cec-e6df-40b8-a238-4f72e3beb610 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.194689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f7cec-e6df-40b8-a238-4f72e3beb610 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.194993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f7cec-e6df-40b8-a238-4f72e3beb610 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.197386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f7cec-e6df-40b8-a238-4f72e3beb610 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.199299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6174a5-e833-48b2-93b5-27917dba65f9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.203625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3002cd-3e5b-4e68-b68e-e2554ffedd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.204265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3002cd-3e5b-4e68-b68e-e2554ffedd38 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.204582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3002cd-3e5b-4e68-b68e-e2554ffedd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.204857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3002cd-3e5b-4e68-b68e-e2554ffedd38 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.205677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3002cd-3e5b-4e68-b68e-e2554ffedd38 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.205981 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3002cd-3e5b-4e68-b68e-e2554ffedd38 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.207798 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3002cd-3e5b-4e68-b68e-e2554ffedd38 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.208813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 232/474] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.210019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87dd90-3b89-4052-bfd7-0d3114053982 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.210306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87dd90-3b89-4052-bfd7-0d3114053982 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.210574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87dd90-3b89-4052-bfd7-0d3114053982 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.212941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 233/475] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:54.213628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87dd90-3b89-4052-bfd7-0d3114053982 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.231729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 243/476] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.231729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3002cd-3e5b-4e68-b68e-e2554ffedd38 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.231951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87dd90-3b89-4052-bfd7-0d3114053982 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.232630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b72c8-7361-4c89-a8dc-15c39296ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.233279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b72c8-7361-4c89-a8dc-15c39296ed5b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.233564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b72c8-7361-4c89-a8dc-15c39296ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.233843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b72c8-7361-4c89-a8dc-15c39296ed5b admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.234562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b72c8-7361-4c89-a8dc-15c39296ed5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.234872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b72c8-7361-4c89-a8dc-15c39296ed5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.236510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b72c8-7361-4c89-a8dc-15c39296ed5b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.236928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3002cd-3e5b-4e68-b68e-e2554ffedd38 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.241346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d026cd-5196-4975-9fd0-a3d172456b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.242225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d026cd-5196-4975-9fd0-a3d172456b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.242509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d026cd-5196-4975-9fd0-a3d172456b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.242784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d026cd-5196-4975-9fd0-a3d172456b2b admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/c711b68b32a7435a93b12553972f9f0e/roles/0bf399b6291e451e9c1560112432ef33` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.249190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 234/477] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.250413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9afb7a-d004-4e6f-84a3-c5c7b910922a None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.250697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9afb7a-d004-4e6f-84a3-c5c7b910922a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.250975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9afb7a-d004-4e6f-84a3-c5c7b910922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.262018 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d026cd-5196-4975-9fd0-a3d172456b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=c711b68b32a7435a93b12553972f9f0e, role_id=0bf399b6291e451e9c1560112432ef33)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.264721 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d026cd-5196-4975-9fd0-a3d172456b2b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.267777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-ef9afb7a-d004-4e6f-84a3-c5c7b910922a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:54.269000 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ef9afb7a-d004-4e6f-84a3-c5c7b910922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:54.276484 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 235/478] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:54.277222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9afb7a-d004-4e6f-84a3-c5c7b910922a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.285816 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9afb7a-d004-4e6f-84a3-c5c7b910922a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.290598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fc01e-7c49-446c-a7d4-75224d2043ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.291438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fc01e-7c49-446c-a7d4-75224d2043ac admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.291719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fc01e-7c49-446c-a7d4-75224d2043ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.291998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fc01e-7c49-446c-a7d4-75224d2043ac admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/6812bbce1050419ea721a9b648b87bef/roles/0bf399b6291e451e9c1560112432ef33` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.307030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fc01e-7c49-446c-a7d4-75224d2043ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=6812bbce1050419ea721a9b648b87bef, role_id=0bf399b6291e451e9c1560112432ef33)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.309753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fc01e-7c49-446c-a7d4-75224d2043ac admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.342152 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 244/479] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:54 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/c711b68b32a7435a93b12553972f9f0e/roles/0bf399b6291e451e9c1560112432ef33 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:54.343018 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d026cd-5196-4975-9fd0-a3d172456b2b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.408688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d026cd-5196-4975-9fd0-a3d172456b2b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.413344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d741f-76d2-4e33-a2a4-17ffa114b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.414688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d741f-76d2-4e33-a2a4-17ffa114b032 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.415104 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d741f-76d2-4e33-a2a4-17ffa114b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.415485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d741f-76d2-4e33-a2a4-17ffa114b032 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.427400 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d741f-76d2-4e33-a2a4-17ffa114b032 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.429495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d741f-76d2-4e33-a2a4-17ffa114b032 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.442228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 236/480] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:54 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/6812bbce1050419ea721a9b648b87bef/roles/0bf399b6291e451e9c1560112432ef33 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:54.443747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fc01e-7c49-446c-a7d4-75224d2043ac admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.447892 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-b81d741f-76d2-4e33-a2a4-17ffa114b032 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:54.449417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 245/481] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.450040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d741f-76d2-4e33-a2a4-17ffa114b032 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.462172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d741f-76d2-4e33-a2a4-17ffa114b032 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.534678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8400f-7e9f-4242-8db2-223afeb76bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.535489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8400f-7e9f-4242-8db2-223afeb76bce admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.535770 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8400f-7e9f-4242-8db2-223afeb76bce admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.536048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8400f-7e9f-4242-8db2-223afeb76bce admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.542411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fc01e-7c49-446c-a7d4-75224d2043ac admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.548424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069f193-d472-4b63-ae7a-f971c5c1caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.552639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8400f-7e9f-4242-8db2-223afeb76bce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:54.552770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069f193-d472-4b63-ae7a-f971c5c1caa7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.552770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069f193-d472-4b63-ae7a-f971c5c1caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.552770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069f193-d472-4b63-ae7a-f971c5c1caa7 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.556167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-70f8400f-7e9f-4242-8db2-223afeb76bce admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:54.557676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 246/482] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.558267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8400f-7e9f-4242-8db2-223afeb76bce admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.559830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069f193-d472-4b63-ae7a-f971c5c1caa7 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.562255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069f193-d472-4b63-ae7a-f971c5c1caa7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.568237 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8400f-7e9f-4242-8db2-223afeb76bce admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.573500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b367e6-41b8-40d3-9a01-c0456c1aab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.574231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b367e6-41b8-40d3-9a01-c0456c1aab8c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.574566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b367e6-41b8-40d3-9a01-c0456c1aab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.574842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b367e6-41b8-40d3-9a01-c0456c1aab8c admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.575649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b367e6-41b8-40d3-9a01-c0456c1aab8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.575966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b367e6-41b8-40d3-9a01-c0456c1aab8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.577795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b367e6-41b8-40d3-9a01-c0456c1aab8c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.581420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-1069f193-d472-4b63-ae7a-f971c5c1caa7 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 04:24:54.582926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 237/483] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/users/neutron => generated 85 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.584183 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069f193-d472-4b63-ae7a-f971c5c1caa7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.596717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069f193-d472-4b63-ae7a-f971c5c1caa7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.603287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 247/484] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.603287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b367e6-41b8-40d3-9a01-c0456c1aab8c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.610929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fef09e-a386-49a4-95c9-bab54c798284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.612544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef09e-a386-49a4-95c9-bab54c798284 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.612976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef09e-a386-49a4-95c9-bab54c798284 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.613689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef09e-a386-49a4-95c9-bab54c798284 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.614603 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fef09e-a386-49a4-95c9-bab54c798284 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.615052 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fef09e-a386-49a4-95c9-bab54c798284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.615921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b367e6-41b8-40d3-9a01-c0456c1aab8c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.617200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fef09e-a386-49a4-95c9-bab54c798284 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.621861 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9f297-ee0f-439f-925f-dad23c3cf74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.622622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9f297-ee0f-439f-925f-dad23c3cf74a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.623010 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9f297-ee0f-439f-925f-dad23c3cf74a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.623354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9f297-ee0f-439f-925f-dad23c3cf74a admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.624306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9f297-ee0f-439f-925f-dad23c3cf74a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.625318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9f297-ee0f-439f-925f-dad23c3cf74a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.628022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9f297-ee0f-439f-925f-dad23c3cf74a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.628984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 238/485] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.630171 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fef09e-a386-49a4-95c9-bab54c798284 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.641994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fef09e-a386-49a4-95c9-bab54c798284 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.647610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c50d8-56b6-4057-8b9c-bf341e06949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.649022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c50d8-56b6-4057-8b9c-bf341e06949b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.649310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c50d8-56b6-4057-8b9c-bf341e06949b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.649587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c50d8-56b6-4057-8b9c-bf341e06949b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.650229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 248/486] 10.222.0.25 () {56 vars in 1161 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.655750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9f297-ee0f-439f-925f-dad23c3cf74a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.658447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c50d8-56b6-4057-8b9c-bf341e06949b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.660558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c50d8-56b6-4057-8b9c-bf341e06949b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.666805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9f297-ee0f-439f-925f-dad23c3cf74a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.671893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d48fac-a161-4bfe-b88b-dedf5703cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.672784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48fac-a161-4bfe-b88b-dedf5703cf2f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.673146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48fac-a161-4bfe-b88b-dedf5703cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.673494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48fac-a161-4bfe-b88b-dedf5703cf2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.676548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c65c50d8-56b6-4057-8b9c-bf341e06949b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:54.676548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 239/487] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.676989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c50d8-56b6-4057-8b9c-bf341e06949b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.687356 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c50d8-56b6-4057-8b9c-bf341e06949b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.688152 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d48fac-a161-4bfe-b88b-dedf5703cf2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.690462 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d48fac-a161-4bfe-b88b-dedf5703cf2f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.697691 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e049644-5918-4570-a556-0e4f840976d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.698488 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e049644-5918-4570-a556-0e4f840976d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.699254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e049644-5918-4570-a556-0e4f840976d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.699540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e049644-5918-4570-a556-0e4f840976d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.710551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e049644-5918-4570-a556-0e4f840976d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.711241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-02d48fac-a161-4bfe-b88b-dedf5703cf2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:54.712761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 249/488] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.713058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e049644-5918-4570-a556-0e4f840976d3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.713757 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d48fac-a161-4bfe-b88b-dedf5703cf2f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.725217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d48fac-a161-4bfe-b88b-dedf5703cf2f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.730110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0934-0101-4dd5-9eee-0f65df83bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.730890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0934-0101-4dd5-9eee-0f65df83bfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.731251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0934-0101-4dd5-9eee-0f65df83bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.731599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0934-0101-4dd5-9eee-0f65df83bfa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.731705 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-2e049644-5918-4570-a556-0e4f840976d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:54.732705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf0934-0101-4dd5-9eee-0f65df83bfa4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.733082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf0934-0101-4dd5-9eee-0f65df83bfa4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.733247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 240/489] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.734006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e049644-5918-4570-a556-0e4f840976d3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.735315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf0934-0101-4dd5-9eee-0f65df83bfa4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.743965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e049644-5918-4570-a556-0e4f840976d3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.748573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26811-3ff4-4de2-8ae2-737598fab430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.749216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26811-3ff4-4de2-8ae2-737598fab430 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.749501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26811-3ff4-4de2-8ae2-737598fab430 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.749780 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26811-3ff4-4de2-8ae2-737598fab430 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.750547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b26811-3ff4-4de2-8ae2-737598fab430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.750660 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 250/490] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.750814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b26811-3ff4-4de2-8ae2-737598fab430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.751722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0934-0101-4dd5-9eee-0f65df83bfa4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.752518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b26811-3ff4-4de2-8ae2-737598fab430 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.764035 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0934-0101-4dd5-9eee-0f65df83bfa4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.764530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 241/491] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.765465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26811-3ff4-4de2-8ae2-737598fab430 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.769138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04932-37f0-4c91-bf55-925cdec8f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.769923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04932-37f0-4c91-bf55-925cdec8f543 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.770281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04932-37f0-4c91-bf55-925cdec8f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.770765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04932-37f0-4c91-bf55-925cdec8f543 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.772190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04932-37f0-4c91-bf55-925cdec8f543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.772528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04932-37f0-4c91-bf55-925cdec8f543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.774957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04932-37f0-4c91-bf55-925cdec8f543 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.776124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26811-3ff4-4de2-8ae2-737598fab430 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.783392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d92051-6f2a-4a84-be40-bd4c473fc737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.784631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d92051-6f2a-4a84-be40-bd4c473fc737 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.784982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d92051-6f2a-4a84-be40-bd4c473fc737 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.785577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d92051-6f2a-4a84-be40-bd4c473fc737 admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/9f041d8d6b5949c48920b729511f3783/roles/0bf399b6291e451e9c1560112432ef33` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.788154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 251/492] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.793399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04932-37f0-4c91-bf55-925cdec8f543 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.807810 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d92051-6f2a-4a84-be40-bd4c473fc737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=9f041d8d6b5949c48920b729511f3783, role_id=0bf399b6291e451e9c1560112432ef33)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.808012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04932-37f0-4c91-bf55-925cdec8f543 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.810951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d92051-6f2a-4a84-be40-bd4c473fc737 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.812624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33d4ea-446d-4edd-885e-ea7cab242b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.813722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33d4ea-446d-4edd-885e-ea7cab242b5e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.814081 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33d4ea-446d-4edd-885e-ea7cab242b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.814860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33d4ea-446d-4edd-885e-ea7cab242b5e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.823411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33d4ea-446d-4edd-885e-ea7cab242b5e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.825590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33d4ea-446d-4edd-885e-ea7cab242b5e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.840744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-3e33d4ea-446d-4edd-885e-ea7cab242b5e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:24:54.847551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 252/493] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.847551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33d4ea-446d-4edd-885e-ea7cab242b5e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.853533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33d4ea-446d-4edd-885e-ea7cab242b5e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.858597 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df90a1-0b13-4dc5-bcee-fe78c07ae42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.859489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df90a1-0b13-4dc5-bcee-fe78c07ae42f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.859843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df90a1-0b13-4dc5-bcee-fe78c07ae42f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.860191 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df90a1-0b13-4dc5-bcee-fe78c07ae42f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.868540 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df90a1-0b13-4dc5-bcee-fe78c07ae42f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.870615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df90a1-0b13-4dc5-bcee-fe78c07ae42f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.884845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-d6df90a1-0b13-4dc5-bcee-fe78c07ae42f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:54.886720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 253/494] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:54.887018 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df90a1-0b13-4dc5-bcee-fe78c07ae42f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.897932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df90a1-0b13-4dc5-bcee-fe78c07ae42f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:54.904190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed41ce-3c6d-4c72-9374-81e73e95f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:54.904996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed41ce-3c6d-4c72-9374-81e73e95f816 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:54.905352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed41ce-3c6d-4c72-9374-81e73e95f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:54.905713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed41ce-3c6d-4c72-9374-81e73e95f816 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:54.906657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed41ce-3c6d-4c72-9374-81e73e95f816 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:54.907049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed41ce-3c6d-4c72-9374-81e73e95f816 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:54.909017 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed41ce-3c6d-4c72-9374-81e73e95f816 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:54.927294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 242/495] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:54 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/9f041d8d6b5949c48920b729511f3783/roles/0bf399b6291e451e9c1560112432ef33 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:54.927294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d92051-6f2a-4a84-be40-bd4c473fc737 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.936391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 254/496] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:54.944469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed41ce-3c6d-4c72-9374-81e73e95f816 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:54.963689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed41ce-3c6d-4c72-9374-81e73e95f816 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:55.010166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d92051-6f2a-4a84-be40-bd4c473fc737 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:55.016758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c6605-8af6-49cb-8a84-82fb32667c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:55.017973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c6605-8af6-49cb-8a84-82fb32667c68 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:55.018472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c6605-8af6-49cb-8a84-82fb32667c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:55.018948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c6605-8af6-49cb-8a84-82fb32667c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:55.020084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c6605-8af6-49cb-8a84-82fb32667c68 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:55.020604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c6605-8af6-49cb-8a84-82fb32667c68 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:55.025231 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c6605-8af6-49cb-8a84-82fb32667c68 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:55.041594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 243/497] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:55.047945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c6605-8af6-49cb-8a84-82fb32667c68 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:55.068392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c6605-8af6-49cb-8a84-82fb32667c68 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:55.073592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebf435-6395-4d0d-8c0a-fc443bd0c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:55.074737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebf435-6395-4d0d-8c0a-fc443bd0c1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:55.075264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebf435-6395-4d0d-8c0a-fc443bd0c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:55.075782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebf435-6395-4d0d-8c0a-fc443bd0c1e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:55.086225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebf435-6395-4d0d-8c0a-fc443bd0c1e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:55.088525 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebf435-6395-4d0d-8c0a-fc443bd0c1e6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:55.089167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb30f6-a7eb-47b1-8bb3-af767fbe8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:55.090082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb30f6-a7eb-47b1-8bb3-af767fbe8736 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:55.090369 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb30f6-a7eb-47b1-8bb3-af767fbe8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:55.090647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb30f6-a7eb-47b1-8bb3-af767fbe8736 admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/a95d2eadd8c7455bb70477e4522c74c3/roles/0bf399b6291e451e9c1560112432ef33` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:55.100682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 255/498] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:55.108719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebf435-6395-4d0d-8c0a-fc443bd0c1e6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:55.117543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb30f6-a7eb-47b1-8bb3-af767fbe8736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=a95d2eadd8c7455bb70477e4522c74c3, role_id=0bf399b6291e451e9c1560112432ef33)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:55.120219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb30f6-a7eb-47b1-8bb3-af767fbe8736 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:55.120669 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebf435-6395-4d0d-8c0a-fc443bd0c1e6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:55.127057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77e9fc-61f1-4664-9c71-f3206d6c5e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:55.128204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77e9fc-61f1-4664-9c71-f3206d6c5e5e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:55.128714 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77e9fc-61f1-4664-9c71-f3206d6c5e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:55.128996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77e9fc-61f1-4664-9c71-f3206d6c5e5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:55.142045 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77e9fc-61f1-4664-9c71-f3206d6c5e5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:55.143905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77e9fc-61f1-4664-9c71-f3206d6c5e5e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:55.163612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-fe77e9fc-61f1-4664-9c71-f3206d6c5e5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:55.165340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 256/499] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:55.171764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77e9fc-61f1-4664-9c71-f3206d6c5e5e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:55.182665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77e9fc-61f1-4664-9c71-f3206d6c5e5e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:55.187132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e814d-1cb2-47b2-983c-ab420678915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:55.187790 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e814d-1cb2-47b2-983c-ab420678915b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:55.188071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e814d-1cb2-47b2-983c-ab420678915b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:55.188347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e814d-1cb2-47b2-983c-ab420678915b admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:55.189091 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e814d-1cb2-47b2-983c-ab420678915b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:55.189399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e814d-1cb2-47b2-983c-ab420678915b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:55.191000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e814d-1cb2-47b2-983c-ab420678915b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:55.203388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 257/500] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:55.209463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e814d-1cb2-47b2-983c-ab420678915b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:55.211187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 244/501] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:55 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/a95d2eadd8c7455bb70477e4522c74c3/roles/0bf399b6291e451e9c1560112432ef33 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:55.220108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e814d-1cb2-47b2-983c-ab420678915b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:55.285241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9adf62-f2bb-42e5-be1f-4b79e20a9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:55.286050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9adf62-f2bb-42e5-be1f-4b79e20a9ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:55.286334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9adf62-f2bb-42e5-be1f-4b79e20a9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:55.286670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9adf62-f2bb-42e5-be1f-4b79e20a9ae2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:55.294373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9adf62-f2bb-42e5-be1f-4b79e20a9ae2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:55.296531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9adf62-f2bb-42e5-be1f-4b79e20a9ae2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:55.311035 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-aa9adf62-f2bb-42e5-be1f-4b79e20a9ae2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:55.312754 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 258/502] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:55.320031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb30f6-a7eb-47b1-8bb3-af767fbe8736 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:55.332666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb30f6-a7eb-47b1-8bb3-af767fbe8736 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:55.340868 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036e756-d490-4d05-b3c3-657ee34e77bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:55.341674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e756-d490-4d05-b3c3-657ee34e77bb admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:55.341961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e756-d490-4d05-b3c3-657ee34e77bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:55.342239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e756-d490-4d05-b3c3-657ee34e77bb admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:55.343200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036e756-d490-4d05-b3c3-657ee34e77bb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:55.343569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036e756-d490-4d05-b3c3-657ee34e77bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:55.345579 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036e756-d490-4d05-b3c3-657ee34e77bb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:55.367460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 245/503] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:55.374344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9adf62-f2bb-42e5-be1f-4b79e20a9ae2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:55.389910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9adf62-f2bb-42e5-be1f-4b79e20a9ae2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:55.397349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ba9fd-0005-4cca-9968-3e1f75ec4829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:55.398023 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ba9fd-0005-4cca-9968-3e1f75ec4829 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:55.399252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ba9fd-0005-4cca-9968-3e1f75ec4829 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:55.399535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ba9fd-0005-4cca-9968-3e1f75ec4829 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:55.400493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ba9fd-0005-4cca-9968-3e1f75ec4829 admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=c23aad5d62b84cd7a4da788500148f7e) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:55.400812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ba9fd-0005-4cca-9968-3e1f75ec4829 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:55.402848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ba9fd-0005-4cca-9968-3e1f75ec4829 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:55.412080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 259/504] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:55 2021] GET /identity/v3/role_assignments?user.id=c23aad5d62b84cd7a4da788500148f7e&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:56.979574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e989-6cdb-4a68-8c2e-2dc23b983755 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:56.980229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e989-6cdb-4a68-8c2e-2dc23b983755 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:56.980229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e989-6cdb-4a68-8c2e-2dc23b983755 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:56.982164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 246/505] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:56.987764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31539-1445-4775-98ca-b1a195a54911 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:56.988252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31539-1445-4775-98ca-b1a195a54911 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:56.988466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31539-1445-4775-98ca-b1a195a54911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.010022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-7fe31539-1445-4775-98ca-b1a195a54911 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:57.011268 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7fe31539-1445-4775-98ca-b1a195a54911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:57.024596 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 260/506] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:57.060845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56e989-6cdb-4a68-8c2e-2dc23b983755 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.077979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56e989-6cdb-4a68-8c2e-2dc23b983755 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.082584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3c580-a2da-49aa-8baf-d854b46774a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.083376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3c580-a2da-49aa-8baf-d854b46774a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.083662 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3c580-a2da-49aa-8baf-d854b46774a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.083941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3c580-a2da-49aa-8baf-d854b46774a0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.098855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3c580-a2da-49aa-8baf-d854b46774a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:57.106305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-13f3c580-a2da-49aa-8baf-d854b46774a0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:57.112462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 247/507] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:57.113923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31539-1445-4775-98ca-b1a195a54911 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.123928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31539-1445-4775-98ca-b1a195a54911 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.132518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d464e3-ee09-4da5-ac78-97be3d25f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.133225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d464e3-ee09-4da5-ac78-97be3d25f96e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.133509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d464e3-ee09-4da5-ac78-97be3d25f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.133787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d464e3-ee09-4da5-ac78-97be3d25f96e admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.134558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d464e3-ee09-4da5-ac78-97be3d25f96e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.134866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d464e3-ee09-4da5-ac78-97be3d25f96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.136536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d464e3-ee09-4da5-ac78-97be3d25f96e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.150630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 261/508] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:57.151897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3c580-a2da-49aa-8baf-d854b46774a0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.166575 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3c580-a2da-49aa-8baf-d854b46774a0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.177290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087c7a-ece6-49e6-aaf9-82be0e84a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.178208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087c7a-ece6-49e6-aaf9-82be0e84a47a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.178493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087c7a-ece6-49e6-aaf9-82be0e84a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.178766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087c7a-ece6-49e6-aaf9-82be0e84a47a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.191155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49087c7a-ece6-49e6-aaf9-82be0e84a47a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.193100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49087c7a-ece6-49e6-aaf9-82be0e84a47a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.214026 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-49087c7a-ece6-49e6-aaf9-82be0e84a47a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:57.215273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 248/509] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:57.221900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d464e3-ee09-4da5-ac78-97be3d25f96e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.232807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d464e3-ee09-4da5-ac78-97be3d25f96e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.240889 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f328e-47f8-44a1-9d87-8c53e379c35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.241569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f328e-47f8-44a1-9d87-8c53e379c35c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.241985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f328e-47f8-44a1-9d87-8c53e379c35c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.242684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f328e-47f8-44a1-9d87-8c53e379c35c admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.243431 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f328e-47f8-44a1-9d87-8c53e379c35c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.243741 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f328e-47f8-44a1-9d87-8c53e379c35c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.245391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f328e-47f8-44a1-9d87-8c53e379c35c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.259116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 262/510] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:57.266418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087c7a-ece6-49e6-aaf9-82be0e84a47a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.277927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087c7a-ece6-49e6-aaf9-82be0e84a47a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.285537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac93e09-de85-43fa-a9c4-974f9b8b6d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.287335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93e09-de85-43fa-a9c4-974f9b8b6d32 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.288085 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93e09-de85-43fa-a9c4-974f9b8b6d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.289400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93e09-de85-43fa-a9c4-974f9b8b6d32 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.304044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac93e09-de85-43fa-a9c4-974f9b8b6d32 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.309153 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac93e09-de85-43fa-a9c4-974f9b8b6d32 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.313043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b477-253b-4d72-a558-2180f6c1fd9b None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.313365 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b477-253b-4d72-a558-2180f6c1fd9b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.313606 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b477-253b-4d72-a558-2180f6c1fd9b None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.315909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 263/511] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:24:57.328381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240435bb-7985-4332-a852-412a28c52a1f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.328381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240435bb-7985-4332-a852-412a28c52a1f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.328381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240435bb-7985-4332-a852-412a28c52a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.342324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-0ac93e09-de85-43fa-a9c4-974f9b8b6d32 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:24:57.348385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 249/512] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/users/cinder => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:57.358029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac93e09-de85-43fa-a9c4-974f9b8b6d32 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.359329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-240435bb-7985-4332-a852-412a28c52a1f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:57.360565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-240435bb-7985-4332-a852-412a28c52a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:57.376003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac93e09-de85-43fa-a9c4-974f9b8b6d32 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.383282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f13ca-d0f1-4d4c-abed-aff479cd631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.385273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f13ca-d0f1-4d4c-abed-aff479cd631b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.386760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 264/513] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:57.387283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f13ca-d0f1-4d4c-abed-aff479cd631b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.387767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f13ca-d0f1-4d4c-abed-aff479cd631b admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.388924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f13ca-d0f1-4d4c-abed-aff479cd631b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.389431 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f13ca-d0f1-4d4c-abed-aff479cd631b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.391524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f13ca-d0f1-4d4c-abed-aff479cd631b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.411149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240435bb-7985-4332-a852-412a28c52a1f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.417832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 250/514] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:57.424319 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f13ca-d0f1-4d4c-abed-aff479cd631b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.426820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240435bb-7985-4332-a852-412a28c52a1f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.434029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f13ca-d0f1-4d4c-abed-aff479cd631b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.437405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb39eaa-990d-4f95-b70a-8aa3cedd5f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.438207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb39eaa-990d-4f95-b70a-8aa3cedd5f60 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.438488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb39eaa-990d-4f95-b70a-8aa3cedd5f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.438762 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb39eaa-990d-4f95-b70a-8aa3cedd5f60 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.444946 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcdaae-616e-4917-a87b-7184ec47ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.445621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdaae-616e-4917-a87b-7184ec47ecbc admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.445903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdaae-616e-4917-a87b-7184ec47ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.446176 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdaae-616e-4917-a87b-7184ec47ecbc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.462109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcdaae-616e-4917-a87b-7184ec47ecbc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.463913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcdaae-616e-4917-a87b-7184ec47ecbc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.468515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb39eaa-990d-4f95-b70a-8aa3cedd5f60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:57.475425 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-ffb39eaa-990d-4f95-b70a-8aa3cedd5f60 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:57.476747 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 265/515] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:57.483564 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb39eaa-990d-4f95-b70a-8aa3cedd5f60 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.483898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 251/516] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:57.494986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcdaae-616e-4917-a87b-7184ec47ecbc admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.505283 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb39eaa-990d-4f95-b70a-8aa3cedd5f60 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.506845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcdaae-616e-4917-a87b-7184ec47ecbc admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.514519 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb608fb-442f-4ce9-a450-704f0c6eba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.515192 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb608fb-442f-4ce9-a450-704f0c6eba12 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.515475 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb608fb-442f-4ce9-a450-704f0c6eba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.515751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb608fb-442f-4ce9-a450-704f0c6eba12 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.516531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb608fb-442f-4ce9-a450-704f0c6eba12 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.516833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb608fb-442f-4ce9-a450-704f0c6eba12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.518433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb608fb-442f-4ce9-a450-704f0c6eba12 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.522317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7a4fe-c46a-46ab-b6ca-48f732e3c9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.523625 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7a4fe-c46a-46ab-b6ca-48f732e3c9ef admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.523909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7a4fe-c46a-46ab-b6ca-48f732e3c9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.524182 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7a4fe-c46a-46ab-b6ca-48f732e3c9ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.539676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 266/517] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:57.546467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb608fb-442f-4ce9-a450-704f0c6eba12 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.549358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7a4fe-c46a-46ab-b6ca-48f732e3c9ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.551248 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7a4fe-c46a-46ab-b6ca-48f732e3c9ef admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.564663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb608fb-442f-4ce9-a450-704f0c6eba12 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.572770 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9f84c-6b58-474c-bbc6-e22c93ceff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.575119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9f84c-6b58-474c-bbc6-e22c93ceff73 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.575402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9f84c-6b58-474c-bbc6-e22c93ceff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.576036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9f84c-6b58-474c-bbc6-e22c93ceff73 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.588127 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-a5c7a4fe-c46a-46ab-b6ca-48f732e3c9ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:57.589612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 252/518] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:57.598803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7a4fe-c46a-46ab-b6ca-48f732e3c9ef admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.604132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9f84c-6b58-474c-bbc6-e22c93ceff73 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.608252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9f84c-6b58-474c-bbc6-e22c93ceff73 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.615112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7a4fe-c46a-46ab-b6ca-48f732e3c9ef admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.625791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90332f5-22f3-4505-a3fe-3dffc10eff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.627545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90332f5-22f3-4505-a3fe-3dffc10eff75 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.627833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90332f5-22f3-4505-a3fe-3dffc10eff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.629007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90332f5-22f3-4505-a3fe-3dffc10eff75 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.631420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90332f5-22f3-4505-a3fe-3dffc10eff75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.631736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90332f5-22f3-4505-a3fe-3dffc10eff75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.633531 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90332f5-22f3-4505-a3fe-3dffc10eff75 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.637406 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-74c9f84c-6b58-474c-bbc6-e22c93ceff73 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:57.640899 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 267/519] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:57.644700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9f84c-6b58-474c-bbc6-e22c93ceff73 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.651854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 253/520] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:57.653387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fbec6-80db-477c-8ec7-f88c62995ecd None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.653682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fbec6-80db-477c-8ec7-f88c62995ecd None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.653964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fbec6-80db-477c-8ec7-f88c62995ecd None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.655653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 254/521] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:57.660554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9f84c-6b58-474c-bbc6-e22c93ceff73 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.661630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fbec6-80db-477c-8ec7-f88c62995ecd None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.666640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dadec-72f6-4b0e-8c55-0c471638527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.667478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dadec-72f6-4b0e-8c55-0c471638527a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.668178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dadec-72f6-4b0e-8c55-0c471638527a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.668614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dadec-72f6-4b0e-8c55-0c471638527a admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.669488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dadec-72f6-4b0e-8c55-0c471638527a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.669934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dadec-72f6-4b0e-8c55-0c471638527a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.671683 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dadec-72f6-4b0e-8c55-0c471638527a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.676072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fbec6-80db-477c-8ec7-f88c62995ecd None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.688376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511c41e-f064-4b19-89d3-ec4d1403223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.688376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511c41e-f064-4b19-89d3-ec4d1403223d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.688376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511c41e-f064-4b19-89d3-ec4d1403223d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.688376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511c41e-f064-4b19-89d3-ec4d1403223d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.690024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 268/522] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:57.690024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f9af4-1cdf-4b6c-9387-731b148653a2 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.690024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f9af4-1cdf-4b6c-9387-731b148653a2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.690024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f9af4-1cdf-4b6c-9387-731b148653a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.694355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511c41e-f064-4b19-89d3-ec4d1403223d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.696671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511c41e-f064-4b19-89d3-ec4d1403223d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.715042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-e511c41e-f064-4b19-89d3-ec4d1403223d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:57.716736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 255/523] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:57.717771 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511c41e-f064-4b19-89d3-ec4d1403223d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.718490 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-fc2f9af4-1cdf-4b6c-9387-731b148653a2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:57.724318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-fc2f9af4-1cdf-4b6c-9387-731b148653a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:57.728171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 269/524] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:57.729026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f9af4-1cdf-4b6c-9387-731b148653a2 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.734150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511c41e-f064-4b19-89d3-ec4d1403223d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.739211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f9af4-1cdf-4b6c-9387-731b148653a2 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.744635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fb2fc-b007-4846-87de-93e857725758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.744768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075810d-bf56-487c-bd36-707eb9857d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.745407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb2fc-b007-4846-87de-93e857725758 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.745565 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075810d-bf56-487c-bd36-707eb9857d0b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.745717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb2fc-b007-4846-87de-93e857725758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.745845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075810d-bf56-487c-bd36-707eb9857d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.745977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb2fc-b007-4846-87de-93e857725758 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.746099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075810d-bf56-487c-bd36-707eb9857d0b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.746829 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fb2fc-b007-4846-87de-93e857725758 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.747166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fb2fc-b007-4846-87de-93e857725758 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.749057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fb2fc-b007-4846-87de-93e857725758 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.762881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 270/525] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:57.766147 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fb2fc-b007-4846-87de-93e857725758 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.776649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fb2fc-b007-4846-87de-93e857725758 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.777358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075810d-bf56-487c-bd36-707eb9857d0b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.779942 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075810d-bf56-487c-bd36-707eb9857d0b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.783629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e03111-db5a-49c2-8c45-b9a4832c48e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.786349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e03111-db5a-49c2-8c45-b9a4832c48e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.786639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e03111-db5a-49c2-8c45-b9a4832c48e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.786923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e03111-db5a-49c2-8c45-b9a4832c48e4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.797511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-0075810d-bf56-487c-bd36-707eb9857d0b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:24:57.799541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 256/526] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:57.804661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075810d-bf56-487c-bd36-707eb9857d0b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.808263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e03111-db5a-49c2-8c45-b9a4832c48e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:57.815042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075810d-bf56-487c-bd36-707eb9857d0b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.816716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-e6e03111-db5a-49c2-8c45-b9a4832c48e4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:57.818433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 271/527] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:57.819222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e03111-db5a-49c2-8c45-b9a4832c48e4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.826102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87aba-559a-48cd-8ee6-a578baf18333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.826812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87aba-559a-48cd-8ee6-a578baf18333 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.827126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87aba-559a-48cd-8ee6-a578baf18333 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.827403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87aba-559a-48cd-8ee6-a578baf18333 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.828295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87aba-559a-48cd-8ee6-a578baf18333 admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=c711b68b32a7435a93b12553972f9f0e) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.828649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87aba-559a-48cd-8ee6-a578baf18333 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.830638 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87aba-559a-48cd-8ee6-a578baf18333 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.830791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e03111-db5a-49c2-8c45-b9a4832c48e4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.836772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae041b84-880b-43c5-a6b0-cfad75d2163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.837471 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae041b84-880b-43c5-a6b0-cfad75d2163b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.837768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae041b84-880b-43c5-a6b0-cfad75d2163b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.838054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae041b84-880b-43c5-a6b0-cfad75d2163b admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.838508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 257/528] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/role_assignments?user.id=c711b68b32a7435a93b12553972f9f0e&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:57.838963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae041b84-880b-43c5-a6b0-cfad75d2163b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.839275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae041b84-880b-43c5-a6b0-cfad75d2163b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.839416 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87aba-559a-48cd-8ee6-a578baf18333 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.841391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae041b84-880b-43c5-a6b0-cfad75d2163b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.850436 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87aba-559a-48cd-8ee6-a578baf18333 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.855989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf144f41-6ac7-4cce-85d0-4cf15de1caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.856746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf144f41-6ac7-4cce-85d0-4cf15de1caa7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.857030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf144f41-6ac7-4cce-85d0-4cf15de1caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.857393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf144f41-6ac7-4cce-85d0-4cf15de1caa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.858173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf144f41-6ac7-4cce-85d0-4cf15de1caa7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.858540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf144f41-6ac7-4cce-85d0-4cf15de1caa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.860385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf144f41-6ac7-4cce-85d0-4cf15de1caa7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.863471 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 272/529] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:57.870304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae041b84-880b-43c5-a6b0-cfad75d2163b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.878334 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 258/530] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:57.879863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf144f41-6ac7-4cce-85d0-4cf15de1caa7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.881155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae041b84-880b-43c5-a6b0-cfad75d2163b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.886587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49d17e-b83d-4531-91c4-570f26552484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.887253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49d17e-b83d-4531-91c4-570f26552484 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.887537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49d17e-b83d-4531-91c4-570f26552484 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.887814 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49d17e-b83d-4531-91c4-570f26552484 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.891960 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf144f41-6ac7-4cce-85d0-4cf15de1caa7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.897531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49d17e-b83d-4531-91c4-570f26552484 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.897826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cd08e-f99f-4f75-9b4f-cbfe622f0955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.898520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cd08e-f99f-4f75-9b4f-cbfe622f0955 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.898861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cd08e-f99f-4f75-9b4f-cbfe622f0955 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.899139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cd08e-f99f-4f75-9b4f-cbfe622f0955 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.899395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49d17e-b83d-4531-91c4-570f26552484 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.909628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 273/531] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:57.911464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cd08e-f99f-4f75-9b4f-cbfe622f0955 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.913411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cd08e-f99f-4f75-9b4f-cbfe622f0955 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.916686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49d17e-b83d-4531-91c4-570f26552484 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.926020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49d17e-b83d-4531-91c4-570f26552484 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.930874 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379bd8b-3c19-4b0d-8e3f-c277bd22630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.931676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379bd8b-3c19-4b0d-8e3f-c277bd22630b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.931961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379bd8b-3c19-4b0d-8e3f-c277bd22630b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.932241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379bd8b-3c19-4b0d-8e3f-c277bd22630b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.932769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-e58cd08e-f99f-4f75-9b4f-cbfe622f0955 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:57.939681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 259/532] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:57.941341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cd08e-f99f-4f75-9b4f-cbfe622f0955 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.944068 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379bd8b-3c19-4b0d-8e3f-c277bd22630b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.946755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379bd8b-3c19-4b0d-8e3f-c277bd22630b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.952805 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cd08e-f99f-4f75-9b4f-cbfe622f0955 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:57.958448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dfc6c-230f-4d3d-8c22-b7a076bc3a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:57.959130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dfc6c-230f-4d3d-8c22-b7a076bc3a0f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.959471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dfc6c-230f-4d3d-8c22-b7a076bc3a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.959751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dfc6c-230f-4d3d-8c22-b7a076bc3a0f admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.960597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dfc6c-230f-4d3d-8c22-b7a076bc3a0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:57.960990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dfc6c-230f-4d3d-8c22-b7a076bc3a0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:57.963693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dfc6c-230f-4d3d-8c22-b7a076bc3a0f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:57.966433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-0379bd8b-3c19-4b0d-8e3f-c277bd22630b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:57.967697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 274/533] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:24:57.973431 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeeb90-be5f-41b7-b077-6bb705678947 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.973742 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeeb90-be5f-41b7-b077-6bb705678947 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.973975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeeb90-be5f-41b7-b077-6bb705678947 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:57.978056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 275/534] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:57 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:57.979555 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeeb90-be5f-41b7-b077-6bb705678947 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:57.984843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 260/535] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:57.986124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b917dd6-434c-4ed0-bcec-320d969c1a06 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:57.986412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b917dd6-434c-4ed0-bcec-320d969c1a06 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:57.986682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b917dd6-434c-4ed0-bcec-320d969c1a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.000965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeeb90-be5f-41b7-b077-6bb705678947 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.007376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f45a3-bb15-4c77-871e-e161bcd50e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.008380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-6b917dd6-434c-4ed0-bcec-320d969c1a06 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:58.008676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f45a3-bb15-4c77-871e-e161bcd50e17 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.009133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f45a3-bb15-4c77-871e-e161bcd50e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.009583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f45a3-bb15-4c77-871e-e161bcd50e17 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.009685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6b917dd6-434c-4ed0-bcec-320d969c1a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:58.010718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f45a3-bb15-4c77-871e-e161bcd50e17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.011213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f45a3-bb15-4c77-871e-e161bcd50e17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.013437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f45a3-bb15-4c77-871e-e161bcd50e17 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.018656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 261/536] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:58.027105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 276/537] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.032403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b917dd6-434c-4ed0-bcec-320d969c1a06 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.033706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f45a3-bb15-4c77-871e-e161bcd50e17 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.046446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f45a3-bb15-4c77-871e-e161bcd50e17 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.047232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b917dd6-434c-4ed0-bcec-320d969c1a06 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.051677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84454ad-7bd6-46ed-abf6-e19ce0df47e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.052956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84454ad-7bd6-46ed-abf6-e19ce0df47e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.053430 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84454ad-7bd6-46ed-abf6-e19ce0df47e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.053989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84454ad-7bd6-46ed-abf6-e19ce0df47e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.059070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c51fe-e728-4dc0-9794-261b8e869ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.060028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c51fe-e728-4dc0-9794-261b8e869ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.060312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c51fe-e728-4dc0-9794-261b8e869ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.060689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c51fe-e728-4dc0-9794-261b8e869ac0 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.064095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84454ad-7bd6-46ed-abf6-e19ce0df47e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.067217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84454ad-7bd6-46ed-abf6-e19ce0df47e3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.071095 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c51fe-e728-4dc0-9794-261b8e869ac0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.073387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c51fe-e728-4dc0-9794-261b8e869ac0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.089068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-3d1c51fe-e728-4dc0-9794-261b8e869ac0 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 04:24:58.089257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-f84454ad-7bd6-46ed-abf6-e19ce0df47e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:58.090733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 262/538] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/users/glance => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.091105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 277/539] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.096037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c51fe-e728-4dc0-9794-261b8e869ac0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.097150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84454ad-7bd6-46ed-abf6-e19ce0df47e3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.106252 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c51fe-e728-4dc0-9794-261b8e869ac0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.107906 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84454ad-7bd6-46ed-abf6-e19ce0df47e3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.110715 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8b84f-37a9-42eb-9a0b-693e485a919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.111581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8b84f-37a9-42eb-9a0b-693e485a919d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.111928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8b84f-37a9-42eb-9a0b-693e485a919d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.112270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8b84f-37a9-42eb-9a0b-693e485a919d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.113134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db04040-baac-4ccd-b6aa-3b087f9bd3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.113800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db04040-baac-4ccd-b6aa-3b087f9bd3ea admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.114087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db04040-baac-4ccd-b6aa-3b087f9bd3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.114366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db04040-baac-4ccd-b6aa-3b087f9bd3ea admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.115208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db04040-baac-4ccd-b6aa-3b087f9bd3ea admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.115535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db04040-baac-4ccd-b6aa-3b087f9bd3ea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.117477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db04040-baac-4ccd-b6aa-3b087f9bd3ea admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.126660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8b84f-37a9-42eb-9a0b-693e485a919d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:58.134198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-a4d8b84f-37a9-42eb-9a0b-693e485a919d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:58.139632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 278/540] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.140325 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db04040-baac-4ccd-b6aa-3b087f9bd3ea admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.142006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 263/541] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.142980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8b84f-37a9-42eb-9a0b-693e485a919d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.151042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db04040-baac-4ccd-b6aa-3b087f9bd3ea admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.154550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8b84f-37a9-42eb-9a0b-693e485a919d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.155645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2b7a7-94b7-4881-8210-f5016ffa6fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.156335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b7a7-94b7-4881-8210-f5016ffa6fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.156628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b7a7-94b7-4881-8210-f5016ffa6fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.156904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b7a7-94b7-4881-8210-f5016ffa6fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.157699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2b7a7-94b7-4881-8210-f5016ffa6fd0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.158008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2b7a7-94b7-4881-8210-f5016ffa6fd0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.159312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3204-1427-4031-8943-33ccd55c7797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.159874 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2b7a7-94b7-4881-8210-f5016ffa6fd0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.160108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3204-1427-4031-8943-33ccd55c7797 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.161627 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3204-1427-4031-8943-33ccd55c7797 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.161627 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3204-1427-4031-8943-33ccd55c7797 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.161627 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d3204-1427-4031-8943-33ccd55c7797 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.161946 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d3204-1427-4031-8943-33ccd55c7797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.163544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d3204-1427-4031-8943-33ccd55c7797 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.174759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 264/542] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.175105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3204-1427-4031-8943-33ccd55c7797 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.177455 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 279/543] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.182487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2b7a7-94b7-4881-8210-f5016ffa6fd0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.191198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3204-1427-4031-8943-33ccd55c7797 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.194127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2b7a7-94b7-4881-8210-f5016ffa6fd0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.195729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8911b1-b1fa-4fd2-8ff2-676e6c5a47be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.196470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8911b1-b1fa-4fd2-8ff2-676e6c5a47be admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.196751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8911b1-b1fa-4fd2-8ff2-676e6c5a47be admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.197020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8911b1-b1fa-4fd2-8ff2-676e6c5a47be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.200816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fb3a3-4f00-4a65-a440-9b47838c80af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.201803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fb3a3-4f00-4a65-a440-9b47838c80af admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.202291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fb3a3-4f00-4a65-a440-9b47838c80af admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.202639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fb3a3-4f00-4a65-a440-9b47838c80af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.206112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8911b1-b1fa-4fd2-8ff2-676e6c5a47be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.207875 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8911b1-b1fa-4fd2-8ff2-676e6c5a47be admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.214785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fb3a3-4f00-4a65-a440-9b47838c80af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.216751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fb3a3-4f00-4a65-a440-9b47838c80af admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.218552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 265/544] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:58.219367 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8911b1-b1fa-4fd2-8ff2-676e6c5a47be admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.228143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8911b1-b1fa-4fd2-8ff2-676e6c5a47be admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.232631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebe47d-b7e6-48e6-9a3d-31d614f20627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.233258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebe47d-b7e6-48e6-9a3d-31d614f20627 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.233534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebe47d-b7e6-48e6-9a3d-31d614f20627 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.233807 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebe47d-b7e6-48e6-9a3d-31d614f20627 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.234384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-b74fb3a3-4f00-4a65-a440-9b47838c80af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:58.234749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebe47d-b7e6-48e6-9a3d-31d614f20627 admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=6812bbce1050419ea721a9b648b87bef) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.235109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebe47d-b7e6-48e6-9a3d-31d614f20627 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.235930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 280/545] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.237158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20490-3d40-4e84-8b3a-bd59a6d1537e None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.237550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20490-3d40-4e84-8b3a-bd59a6d1537e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.237890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20490-3d40-4e84-8b3a-bd59a6d1537e None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.239730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 281/546] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:24:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:24:58.244803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20490-3d40-4e84-8b3a-bd59a6d1537e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.244935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebe47d-b7e6-48e6-9a3d-31d614f20627 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.249295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 266/547] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/role_assignments?user.id=6812bbce1050419ea721a9b648b87bef&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.249938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebe47d-b7e6-48e6-9a3d-31d614f20627 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.260093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebe47d-b7e6-48e6-9a3d-31d614f20627 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.262167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20490-3d40-4e84-8b3a-bd59a6d1537e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.264982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222881b8-4e5e-4b85-9199-8024242ab63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.265663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222881b8-4e5e-4b85-9199-8024242ab63e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.265942 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222881b8-4e5e-4b85-9199-8024242ab63e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.266213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222881b8-4e5e-4b85-9199-8024242ab63e admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.266964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222881b8-4e5e-4b85-9199-8024242ab63e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.267381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222881b8-4e5e-4b85-9199-8024242ab63e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.268583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e362d-fb61-4a7e-b3b7-e5c0faa5286c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.269075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222881b8-4e5e-4b85-9199-8024242ab63e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.269847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e362d-fb61-4a7e-b3b7-e5c0faa5286c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.270340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e362d-fb61-4a7e-b3b7-e5c0faa5286c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.271077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e362d-fb61-4a7e-b3b7-e5c0faa5286c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.282772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 267/548] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.284145 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff3ebe-7fca-4f68-992c-648560b7b0d1 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.286407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e362d-fb61-4a7e-b3b7-e5c0faa5286c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.288562 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e362d-fb61-4a7e-b3b7-e5c0faa5286c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.289639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff3ebe-7fca-4f68-992c-648560b7b0d1 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.290029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff3ebe-7fca-4f68-992c-648560b7b0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.309532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-91ff3ebe-7fca-4f68-992c-648560b7b0d1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:58.310613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-4b6e362d-fb61-4a7e-b3b7-e5c0faa5286c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:58.310733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-91ff3ebe-7fca-4f68-992c-648560b7b0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:58.312573 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 282/549] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.313693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e362d-fb61-4a7e-b3b7-e5c0faa5286c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.319613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 268/550] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:24:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:58.321631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff3ebe-7fca-4f68-992c-648560b7b0d1 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.325373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e362d-fb61-4a7e-b3b7-e5c0faa5286c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.331647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff3ebe-7fca-4f68-992c-648560b7b0d1 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.332023 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b8b7d-706d-4d44-babc-4314c39ea459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.333215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b8b7d-706d-4d44-babc-4314c39ea459 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.333709 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b8b7d-706d-4d44-babc-4314c39ea459 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.334188 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b8b7d-706d-4d44-babc-4314c39ea459 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.344077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b8b7d-706d-4d44-babc-4314c39ea459 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.346502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b8b7d-706d-4d44-babc-4314c39ea459 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.348060 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31381c-c83c-48c3-ae29-38fc578a6bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.348849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31381c-c83c-48c3-ae29-38fc578a6bff admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.349158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31381c-c83c-48c3-ae29-38fc578a6bff admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.349664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31381c-c83c-48c3-ae29-38fc578a6bff admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.350401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31381c-c83c-48c3-ae29-38fc578a6bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.350833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31381c-c83c-48c3-ae29-38fc578a6bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.352875 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31381c-c83c-48c3-ae29-38fc578a6bff admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.368636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-7e5b8b7d-706d-4d44-babc-4314c39ea459 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:24:58.370543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 283/551] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.371564 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b8b7d-706d-4d44-babc-4314c39ea459 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.376033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 269/552] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.377989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31381c-c83c-48c3-ae29-38fc578a6bff admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.383500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b8b7d-706d-4d44-babc-4314c39ea459 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.388659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeffb6-4552-4d1c-9f7a-96c3db26a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.389783 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeffb6-4552-4d1c-9f7a-96c3db26a914 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.390160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31381c-c83c-48c3-ae29-38fc578a6bff admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.390475 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeffb6-4552-4d1c-9f7a-96c3db26a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.390926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeffb6-4552-4d1c-9f7a-96c3db26a914 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.394994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851dcf3-1fc4-42dc-81f9-2ad215f287b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.395737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851dcf3-1fc4-42dc-81f9-2ad215f287b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.396018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851dcf3-1fc4-42dc-81f9-2ad215f287b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.396346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851dcf3-1fc4-42dc-81f9-2ad215f287b2 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.397353 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851dcf3-1fc4-42dc-81f9-2ad215f287b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.397756 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851dcf3-1fc4-42dc-81f9-2ad215f287b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.399876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851dcf3-1fc4-42dc-81f9-2ad215f287b2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.405390 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffeffb6-4552-4d1c-9f7a-96c3db26a914 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:24:58.412765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-bffeffb6-4552-4d1c-9f7a-96c3db26a914 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:24:58.414766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 284/553] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.415960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeffb6-4552-4d1c-9f7a-96c3db26a914 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.421470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 270/554] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:58.422392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851dcf3-1fc4-42dc-81f9-2ad215f287b2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.428228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeffb6-4552-4d1c-9f7a-96c3db26a914 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.441171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a45bd-65cc-45b6-bb04-2a3f00744153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.442241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a45bd-65cc-45b6-bb04-2a3f00744153 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.442622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a45bd-65cc-45b6-bb04-2a3f00744153 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.442998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a45bd-65cc-45b6-bb04-2a3f00744153 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.445866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851dcf3-1fc4-42dc-81f9-2ad215f287b2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.451514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a45bd-65cc-45b6-bb04-2a3f00744153 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.451934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3728b-e128-4991-98c8-8f0e93e4650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.453109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3728b-e128-4991-98c8-8f0e93e4650b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.453546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a45bd-65cc-45b6-bb04-2a3f00744153 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.453698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3728b-e128-4991-98c8-8f0e93e4650b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.454098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3728b-e128-4991-98c8-8f0e93e4650b admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.454987 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3728b-e128-4991-98c8-8f0e93e4650b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.455452 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3728b-e128-4991-98c8-8f0e93e4650b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.457302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3728b-e128-4991-98c8-8f0e93e4650b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.467979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 271/555] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.468341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-c61a45bd-65cc-45b6-bb04-2a3f00744153 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:58.469155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3728b-e128-4991-98c8-8f0e93e4650b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.469929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 285/556] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.473852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a45bd-65cc-45b6-bb04-2a3f00744153 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.481035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3728b-e128-4991-98c8-8f0e93e4650b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.485182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a45bd-65cc-45b6-bb04-2a3f00744153 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.488187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a03ac0-ee73-45bd-a7e4-ee8b032b4644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.489036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a03ac0-ee73-45bd-a7e4-ee8b032b4644 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.489315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a03ac0-ee73-45bd-a7e4-ee8b032b4644 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.489593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a03ac0-ee73-45bd-a7e4-ee8b032b4644 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.491002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12609ec-3033-4cfb-aa6b-24270656f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.492331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12609ec-3033-4cfb-aa6b-24270656f409 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.492634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12609ec-3033-4cfb-aa6b-24270656f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.492911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12609ec-3033-4cfb-aa6b-24270656f409 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.503913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a03ac0-ee73-45bd-a7e4-ee8b032b4644 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.505836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a03ac0-ee73-45bd-a7e4-ee8b032b4644 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.510139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12609ec-3033-4cfb-aa6b-24270656f409 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.511979 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12609ec-3033-4cfb-aa6b-24270656f409 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.525335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-d9a03ac0-ee73-45bd-a7e4-ee8b032b4644 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:58.531837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 272/557] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.531837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a03ac0-ee73-45bd-a7e4-ee8b032b4644 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.532016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-b12609ec-3033-4cfb-aa6b-24270656f409 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:58.534116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 286/558] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.534395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12609ec-3033-4cfb-aa6b-24270656f409 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.543956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a03ac0-ee73-45bd-a7e4-ee8b032b4644 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.545331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12609ec-3033-4cfb-aa6b-24270656f409 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.548658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7e7f4-008d-49ef-b707-47c1ab7c6ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.549409 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7e7f4-008d-49ef-b707-47c1ab7c6ccf admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.549720 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7e7f4-008d-49ef-b707-47c1ab7c6ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.550006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7e7f4-008d-49ef-b707-47c1ab7c6ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.550444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c8ad0-4692-483c-898c-41c3e0bc4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.550797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7e7f4-008d-49ef-b707-47c1ab7c6ccf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.551108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7e7f4-008d-49ef-b707-47c1ab7c6ccf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.551214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8ad0-4692-483c-898c-41c3e0bc4543 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.551460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8ad0-4692-483c-898c-41c3e0bc4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.551737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8ad0-4692-483c-898c-41c3e0bc4543 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.552545 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c8ad0-4692-483c-898c-41c3e0bc4543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.552850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c8ad0-4692-483c-898c-41c3e0bc4543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.553017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7e7f4-008d-49ef-b707-47c1ab7c6ccf admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.555223 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c8ad0-4692-483c-898c-41c3e0bc4543 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.567463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 287/559] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.568149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c8ad0-4692-483c-898c-41c3e0bc4543 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.568663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 273/560] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.574573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7e7f4-008d-49ef-b707-47c1ab7c6ccf admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.583200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c8ad0-4692-483c-898c-41c3e0bc4543 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.586749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7e7f4-008d-49ef-b707-47c1ab7c6ccf admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.587567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dd589-0aba-4764-86c4-434fdda5ab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.588221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd589-0aba-4764-86c4-434fdda5ab0c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.588537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd589-0aba-4764-86c4-434fdda5ab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.588835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd589-0aba-4764-86c4-434fdda5ab0c admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.589525 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd589-0aba-4764-86c4-434fdda5ab0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.589823 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd589-0aba-4764-86c4-434fdda5ab0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.591387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd589-0aba-4764-86c4-434fdda5ab0c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.592536 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6866ae-fa91-440a-ba96-2efbb55e8be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.594114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6866ae-fa91-440a-ba96-2efbb55e8be8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.594543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6866ae-fa91-440a-ba96-2efbb55e8be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.594967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6866ae-fa91-440a-ba96-2efbb55e8be8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.603172 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6866ae-fa91-440a-ba96-2efbb55e8be8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.605187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6866ae-fa91-440a-ba96-2efbb55e8be8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.606060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 288/561] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.607021 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dd589-0aba-4764-86c4-434fdda5ab0c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.616602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dd589-0aba-4764-86c4-434fdda5ab0c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.619168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-4f6866ae-fa91-440a-ba96-2efbb55e8be8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:58.620516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 274/562] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.621130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6866ae-fa91-440a-ba96-2efbb55e8be8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.622619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad456f4e-6929-4ac3-aaac-dacf63b54d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.623428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad456f4e-6929-4ac3-aaac-dacf63b54d52 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.623856 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad456f4e-6929-4ac3-aaac-dacf63b54d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.624296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad456f4e-6929-4ac3-aaac-dacf63b54d52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.625338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad456f4e-6929-4ac3-aaac-dacf63b54d52 admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=9f041d8d6b5949c48920b729511f3783) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.625802 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad456f4e-6929-4ac3-aaac-dacf63b54d52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.627784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad456f4e-6929-4ac3-aaac-dacf63b54d52 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.634111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 289/563] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/role_assignments?user.id=9f041d8d6b5949c48920b729511f3783&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.635082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad456f4e-6929-4ac3-aaac-dacf63b54d52 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.636904 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6866ae-fa91-440a-ba96-2efbb55e8be8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.641563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612253b5-780e-4781-a151-a927e77a7ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.642465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612253b5-780e-4781-a151-a927e77a7ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.642748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612253b5-780e-4781-a151-a927e77a7ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.643022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612253b5-780e-4781-a151-a927e77a7ed2 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.646025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad456f4e-6929-4ac3-aaac-dacf63b54d52 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.651019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11423a93-df6f-4ceb-a913-932554dcedb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.651712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612253b5-780e-4781-a151-a927e77a7ed2 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.651846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11423a93-df6f-4ceb-a913-932554dcedb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.652070 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11423a93-df6f-4ceb-a913-932554dcedb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.652373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11423a93-df6f-4ceb-a913-932554dcedb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.653267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11423a93-df6f-4ceb-a913-932554dcedb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.653579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11423a93-df6f-4ceb-a913-932554dcedb7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.655055 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612253b5-780e-4781-a151-a927e77a7ed2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.655731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11423a93-df6f-4ceb-a913-932554dcedb7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.670766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 290/564] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.671155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-612253b5-780e-4781-a151-a927e77a7ed2 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 04:24:58.677304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 275/565] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.680411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11423a93-df6f-4ceb-a913-932554dcedb7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.689643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612253b5-780e-4781-a151-a927e77a7ed2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.696466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11423a93-df6f-4ceb-a913-932554dcedb7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.702167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612253b5-780e-4781-a151-a927e77a7ed2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.708411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c24a04-e5f3-4012-8a3e-503b6d7f9bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.709313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c24a04-e5f3-4012-8a3e-503b6d7f9bed admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.709596 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c24a04-e5f3-4012-8a3e-503b6d7f9bed admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.709867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c24a04-e5f3-4012-8a3e-503b6d7f9bed admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/c23aad5d62b84cd7a4da788500148f7e/roles/0bf399b6291e451e9c1560112432ef33` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.712829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad356a-fcb7-465a-bee2-7a9c4255bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.713512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad356a-fcb7-465a-bee2-7a9c4255bc62 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.713785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad356a-fcb7-465a-bee2-7a9c4255bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.714056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad356a-fcb7-465a-bee2-7a9c4255bc62 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.714927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad356a-fcb7-465a-bee2-7a9c4255bc62 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.715226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad356a-fcb7-465a-bee2-7a9c4255bc62 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.717173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad356a-fcb7-465a-bee2-7a9c4255bc62 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.745377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c24a04-e5f3-4012-8a3e-503b6d7f9bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=c23aad5d62b84cd7a4da788500148f7e, role_id=0bf399b6291e451e9c1560112432ef33)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.748138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c24a04-e5f3-4012-8a3e-503b6d7f9bed admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.754823 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 276/566] 10.222.0.25 () {56 vars in 1161 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:58.762223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad356a-fcb7-465a-bee2-7a9c4255bc62 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.774679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad356a-fcb7-465a-bee2-7a9c4255bc62 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.779748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2926c51-d777-440f-8d15-ea237e9f79d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.780624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926c51-d777-440f-8d15-ea237e9f79d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.781014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926c51-d777-440f-8d15-ea237e9f79d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.781358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926c51-d777-440f-8d15-ea237e9f79d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.791921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2926c51-d777-440f-8d15-ea237e9f79d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.794124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2926c51-d777-440f-8d15-ea237e9f79d9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.805381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 277/567] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:58.811945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2926c51-d777-440f-8d15-ea237e9f79d9 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.822560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2926c51-d777-440f-8d15-ea237e9f79d9 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.831006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 291/568] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:24:58 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/c23aad5d62b84cd7a4da788500148f7e/roles/0bf399b6291e451e9c1560112432ef33 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:58.885924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ea3d6-cd07-4086-b2f1-2e111af0c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.886739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ea3d6-cd07-4086-b2f1-2e111af0c076 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.887029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ea3d6-cd07-4086-b2f1-2e111af0c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.887306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ea3d6-cd07-4086-b2f1-2e111af0c076 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.899383 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ea3d6-cd07-4086-b2f1-2e111af0c076 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.901299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ea3d6-cd07-4086-b2f1-2e111af0c076 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.920592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-ee5ea3d6-cd07-4086-b2f1-2e111af0c076 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:24:58.922194 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 278/569] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:58.928499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c24a04-e5f3-4012-8a3e-503b6d7f9bed admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.941065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c24a04-e5f3-4012-8a3e-503b6d7f9bed admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.946119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1f71a-7366-4f8b-9412-b4a45666266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.946845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f71a-7366-4f8b-9412-b4a45666266a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.947137 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f71a-7366-4f8b-9412-b4a45666266a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.947417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f71a-7366-4f8b-9412-b4a45666266a admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.948159 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1f71a-7366-4f8b-9412-b4a45666266a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:58.948533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1f71a-7366-4f8b-9412-b4a45666266a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.950274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1f71a-7366-4f8b-9412-b4a45666266a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:58.965586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 292/570] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:58.971905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ea3d6-cd07-4086-b2f1-2e111af0c076 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:58.982707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ea3d6-cd07-4086-b2f1-2e111af0c076 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:58.987517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c001c8b-cd3e-40b1-990f-3999acb0c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:58.988380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c001c8b-cd3e-40b1-990f-3999acb0c90d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:58.988713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c001c8b-cd3e-40b1-990f-3999acb0c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:58.988989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c001c8b-cd3e-40b1-990f-3999acb0c90d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:58.997970 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c001c8b-cd3e-40b1-990f-3999acb0c90d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:58.999955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c001c8b-cd3e-40b1-990f-3999acb0c90d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:59.015546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-8c001c8b-cd3e-40b1-990f-3999acb0c90d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:24:59.017183 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 279/571] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:24:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:24:59.023413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1f71a-7366-4f8b-9412-b4a45666266a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:59.033947 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1f71a-7366-4f8b-9412-b4a45666266a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:59.038919 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc6202-8475-4295-97ac-de0d102c2336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:59.039799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc6202-8475-4295-97ac-de0d102c2336 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:59.040090 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc6202-8475-4295-97ac-de0d102c2336 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:59.040411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc6202-8475-4295-97ac-de0d102c2336 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:59.041233 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc6202-8475-4295-97ac-de0d102c2336 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:59.041548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc6202-8475-4295-97ac-de0d102c2336 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:59.043919 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc6202-8475-4295-97ac-de0d102c2336 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:59.058831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 293/572] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:24:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:59.065192 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c001c8b-cd3e-40b1-990f-3999acb0c90d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:59.078373 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c001c8b-cd3e-40b1-990f-3999acb0c90d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:59.083178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f17007-d85c-4cf6-9f92-f48b7ddb9bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:59.083869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f17007-d85c-4cf6-9f92-f48b7ddb9bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:59.084176 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f17007-d85c-4cf6-9f92-f48b7ddb9bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:59.084581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f17007-d85c-4cf6-9f92-f48b7ddb9bc9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:59.085420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f17007-d85c-4cf6-9f92-f48b7ddb9bc9 admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=a95d2eadd8c7455bb70477e4522c74c3) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:59.086242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f17007-d85c-4cf6-9f92-f48b7ddb9bc9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:59.088111 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f17007-d85c-4cf6-9f92-f48b7ddb9bc9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:59.096922 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 280/573] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:24:59 2021] GET /identity/v3/role_assignments?user.id=a95d2eadd8c7455bb70477e4522c74c3&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:00.410611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cdc78-3500-4b61-ab06-4e4f586752e8 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:00.411125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cdc78-3500-4b61-ab06-4e4f586752e8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:00.411227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cdc78-3500-4b61-ab06-4e4f586752e8 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:00.413150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 294/574] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:00.420738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19448f42-57db-4c09-8f4a-3f622c7cc2c5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:00.421601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19448f42-57db-4c09-8f4a-3f622c7cc2c5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:00.422072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19448f42-57db-4c09-8f4a-3f622c7cc2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:00.453403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-19448f42-57db-4c09-8f4a-3f622c7cc2c5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:00.454958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-19448f42-57db-4c09-8f4a-3f622c7cc2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:00.463901 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 281/575] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:00.487586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cdc78-3500-4b61-ab06-4e4f586752e8 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:00.500937 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cdc78-3500-4b61-ab06-4e4f586752e8 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:00.505347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66209ab7-3b75-4aa7-8100-47a4b5681c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:00.506149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209ab7-3b75-4aa7-8100-47a4b5681c5b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:00.506427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209ab7-3b75-4aa7-8100-47a4b5681c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:00.506701 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209ab7-3b75-4aa7-8100-47a4b5681c5b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:00.507376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66209ab7-3b75-4aa7-8100-47a4b5681c5b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:00.508445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-66209ab7-3b75-4aa7-8100-47a4b5681c5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:00.508445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:25:00.508445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:25:00.509335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66209ab7-3b75-4aa7-8100-47a4b5681c5b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:00.522964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-66209ab7-3b75-4aa7-8100-47a4b5681c5b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:25:00.525069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 295/576] 10.222.0.25 () {56 vars in 1151 bytes} [Fri Aug 27 04:25:00 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:00.531513 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19448f42-57db-4c09-8f4a-3f622c7cc2c5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:00.543995 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19448f42-57db-4c09-8f4a-3f622c7cc2c5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:00.557023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e8620-158f-45a8-a8fe-9736b61384e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:00.557699 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e8620-158f-45a8-a8fe-9736b61384e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:00.557980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e8620-158f-45a8-a8fe-9736b61384e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:00.558254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e8620-158f-45a8-a8fe-9736b61384e2 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:00.558973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e8620-158f-45a8-a8fe-9736b61384e2 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:00.563291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e8620-158f-45a8-a8fe-9736b61384e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:00.563291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-785e8620-158f-45a8-a8fe-9736b61384e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:00.563291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:25:00.563291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:25:00.563291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e8620-158f-45a8-a8fe-9736b61384e2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:00.566284 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 282/577] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 04:25:00 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:00.573176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66209ab7-3b75-4aa7-8100-47a4b5681c5b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:00.583489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66209ab7-3b75-4aa7-8100-47a4b5681c5b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:00.596770 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dbb14-72eb-466d-904b-11438416ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:00.597758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbb14-72eb-466d-904b-11438416ef19 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:00.598246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbb14-72eb-466d-904b-11438416ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:00.598745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbb14-72eb-466d-904b-11438416ef19 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:00.599669 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dbb14-72eb-466d-904b-11438416ef19 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:00.600173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dbb14-72eb-466d-904b-11438416ef19 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:00.601388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-a33dbb14-72eb-466d-904b-11438416ef19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:00.601388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:25:00.601388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:25:00.603478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dbb14-72eb-466d-904b-11438416ef19 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:00.609499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 296/578] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 04:25:00 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:00.927594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a1dde-b2ef-4469-94fe-ba183ed95804 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:00.927981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a1dde-b2ef-4469-94fe-ba183ed95804 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:00.928181 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a1dde-b2ef-4469-94fe-ba183ed95804 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:00.930236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 283/579] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:00.936559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09dfa7-2fcf-4ff9-a953-934b1eeb4a19 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:00.937111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09dfa7-2fcf-4ff9-a953-934b1eeb4a19 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:00.937593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09dfa7-2fcf-4ff9-a953-934b1eeb4a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:00.958010 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ee09dfa7-2fcf-4ff9-a953-934b1eeb4a19 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:00.959551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ee09dfa7-2fcf-4ff9-a953-934b1eeb4a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:00.972458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 297/580] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:00.993343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a1dde-b2ef-4469-94fe-ba183ed95804 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.014226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a1dde-b2ef-4469-94fe-ba183ed95804 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.024976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e19e3b-1db1-4d45-bd5a-71fd396f8194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.025759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19e3b-1db1-4d45-bd5a-71fd396f8194 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.026035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19e3b-1db1-4d45-bd5a-71fd396f8194 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.026307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19e3b-1db1-4d45-bd5a-71fd396f8194 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.045231 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e19e3b-1db1-4d45-bd5a-71fd396f8194 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:01.051952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-12e19e3b-1db1-4d45-bd5a-71fd396f8194 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:25:01.053489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 284/581] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:01.060035 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09dfa7-2fcf-4ff9-a953-934b1eeb4a19 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.074080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09dfa7-2fcf-4ff9-a953-934b1eeb4a19 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.078875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a534-379f-4fc1-9818-1e7aa2300288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.079791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a534-379f-4fc1-9818-1e7aa2300288 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.080275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a534-379f-4fc1-9818-1e7aa2300288 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.080787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a534-379f-4fc1-9818-1e7aa2300288 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.088445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a534-379f-4fc1-9818-1e7aa2300288 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:01.089013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a534-379f-4fc1-9818-1e7aa2300288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.090840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a534-379f-4fc1-9818-1e7aa2300288 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.104091 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 298/582] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:01.110610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e19e3b-1db1-4d45-bd5a-71fd396f8194 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.126837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e19e3b-1db1-4d45-bd5a-71fd396f8194 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.141123 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d2625-3e0c-4e90-a2f1-5e56733dffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.141932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d2625-3e0c-4e90-a2f1-5e56733dffa0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.142210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d2625-3e0c-4e90-a2f1-5e56733dffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.142476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d2625-3e0c-4e90-a2f1-5e56733dffa0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.160180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d2625-3e0c-4e90-a2f1-5e56733dffa0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.162057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d2625-3e0c-4e90-a2f1-5e56733dffa0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.188750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-856d2625-3e0c-4e90-a2f1-5e56733dffa0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:01.190251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 285/583] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:01.196920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a534-379f-4fc1-9818-1e7aa2300288 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.213724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a534-379f-4fc1-9818-1e7aa2300288 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.218558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011fa42-535b-4e04-b109-54dc9ddec593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.219481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011fa42-535b-4e04-b109-54dc9ddec593 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.219967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011fa42-535b-4e04-b109-54dc9ddec593 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.220469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011fa42-535b-4e04-b109-54dc9ddec593 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.228392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011fa42-535b-4e04-b109-54dc9ddec593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:01.229068 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011fa42-535b-4e04-b109-54dc9ddec593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.230901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011fa42-535b-4e04-b109-54dc9ddec593 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.247220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 299/584] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:01.253728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d2625-3e0c-4e90-a2f1-5e56733dffa0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.269639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d2625-3e0c-4e90-a2f1-5e56733dffa0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.280585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70438f90-b0b3-4b30-9a8d-a32d5f2017bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.281374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70438f90-b0b3-4b30-9a8d-a32d5f2017bd admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.281653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70438f90-b0b3-4b30-9a8d-a32d5f2017bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.281925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70438f90-b0b3-4b30-9a8d-a32d5f2017bd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.298471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70438f90-b0b3-4b30-9a8d-a32d5f2017bd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.300543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70438f90-b0b3-4b30-9a8d-a32d5f2017bd admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.319430 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-70438f90-b0b3-4b30-9a8d-a32d5f2017bd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:25:01.321564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 286/585] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:01.327871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011fa42-535b-4e04-b109-54dc9ddec593 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.341492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011fa42-535b-4e04-b109-54dc9ddec593 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.346248 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76b336-2e48-4632-9e4e-9abaec247c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.347167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76b336-2e48-4632-9e4e-9abaec247c47 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.347670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76b336-2e48-4632-9e4e-9abaec247c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.348144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76b336-2e48-4632-9e4e-9abaec247c47 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.349209 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76b336-2e48-4632-9e4e-9abaec247c47 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:01.349737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76b336-2e48-4632-9e4e-9abaec247c47 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.356379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76b336-2e48-4632-9e4e-9abaec247c47 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.387748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 300/586] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:01.394317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70438f90-b0b3-4b30-9a8d-a32d5f2017bd admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.407595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70438f90-b0b3-4b30-9a8d-a32d5f2017bd admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.421233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe2583-f876-452c-9a30-ae07653c4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.421885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe2583-f876-452c-9a30-ae07653c4770 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.422169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe2583-f876-452c-9a30-ae07653c4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.422440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe2583-f876-452c-9a30-ae07653c4770 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.432930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe2583-f876-452c-9a30-ae07653c4770 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.434758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe2583-f876-452c-9a30-ae07653c4770 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.459680 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 287/587] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:01.465949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76b336-2e48-4632-9e4e-9abaec247c47 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.482913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76b336-2e48-4632-9e4e-9abaec247c47 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.487762 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb07a4f-d64f-49c1-a0d4-388fb52157b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.492893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07a4f-d64f-49c1-a0d4-388fb52157b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.493437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07a4f-d64f-49c1-a0d4-388fb52157b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.493926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07a4f-d64f-49c1-a0d4-388fb52157b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.505107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978f28c-41d2-4e85-847c-0ac4b0308943 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.505540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978f28c-41d2-4e85-847c-0ac4b0308943 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.508379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978f28c-41d2-4e85-847c-0ac4b0308943 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.509639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 288/588] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:01 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:01.510023 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb07a4f-d64f-49c1-a0d4-388fb52157b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.512215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb07a4f-d64f-49c1-a0d4-388fb52157b2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.515885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf575228-5609-4b0c-b713-18c5c2cc64d2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.517200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf575228-5609-4b0c-b713-18c5c2cc64d2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.521555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf575228-5609-4b0c-b713-18c5c2cc64d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.539190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-9cb07a4f-d64f-49c1-a0d4-388fb52157b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:01.545942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 301/589] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:01.551186 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-cf575228-5609-4b0c-b713-18c5c2cc64d2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:01.551838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb07a4f-d64f-49c1-a0d4-388fb52157b2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.552977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-cf575228-5609-4b0c-b713-18c5c2cc64d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:01.565113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb07a4f-d64f-49c1-a0d4-388fb52157b2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.570614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 289/590] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:01.579155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fa13a-6ee9-49a8-b6c1-aaa29f037d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.579837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa13a-6ee9-49a8-b6c1-aaa29f037d6f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.580168 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa13a-6ee9-49a8-b6c1-aaa29f037d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.580464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa13a-6ee9-49a8-b6c1-aaa29f037d6f admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.581204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fa13a-6ee9-49a8-b6c1-aaa29f037d6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:01.581561 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fa13a-6ee9-49a8-b6c1-aaa29f037d6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.583210 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fa13a-6ee9-49a8-b6c1-aaa29f037d6f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.593497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf575228-5609-4b0c-b713-18c5c2cc64d2 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.604256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf575228-5609-4b0c-b713-18c5c2cc64d2 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.611141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec90ee-384e-4f2a-8f92-c80b38dc175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.612167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec90ee-384e-4f2a-8f92-c80b38dc175d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.612469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec90ee-384e-4f2a-8f92-c80b38dc175d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.614190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec90ee-384e-4f2a-8f92-c80b38dc175d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.615969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 302/591] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:01.629420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fa13a-6ee9-49a8-b6c1-aaa29f037d6f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.641404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fa13a-6ee9-49a8-b6c1-aaa29f037d6f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.642401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec90ee-384e-4f2a-8f92-c80b38dc175d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:01.652053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5a2c5-332b-45e2-834f-67568d4ad817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.652904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5a2c5-332b-45e2-834f-67568d4ad817 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.653189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5a2c5-332b-45e2-834f-67568d4ad817 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.653465 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5a2c5-332b-45e2-834f-67568d4ad817 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.657695 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-fcec90ee-384e-4f2a-8f92-c80b38dc175d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:25:01.660711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 290/592] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:01.667013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5a2c5-332b-45e2-834f-67568d4ad817 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.669393 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5a2c5-332b-45e2-834f-67568d4ad817 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.670696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec90ee-384e-4f2a-8f92-c80b38dc175d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.689117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec90ee-384e-4f2a-8f92-c80b38dc175d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.697181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-4aa5a2c5-332b-45e2-834f-67568d4ad817 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:01.700065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 303/593] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:01.700722 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361589f-3013-400c-ba88-85c1710cd356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.701527 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361589f-3013-400c-ba88-85c1710cd356 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.701808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361589f-3013-400c-ba88-85c1710cd356 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.702080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361589f-3013-400c-ba88-85c1710cd356 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.702938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361589f-3013-400c-ba88-85c1710cd356 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:01.703241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361589f-3013-400c-ba88-85c1710cd356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.704988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361589f-3013-400c-ba88-85c1710cd356 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.706932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5a2c5-332b-45e2-834f-67568d4ad817 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.724805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5a2c5-332b-45e2-834f-67568d4ad817 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.728496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 291/594] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:01.732312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361589f-3013-400c-ba88-85c1710cd356 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.741188 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47797b65-5b6d-442f-b688-21bc0494f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.742945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47797b65-5b6d-442f-b688-21bc0494f74b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.743145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47797b65-5b6d-442f-b688-21bc0494f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.743307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47797b65-5b6d-442f-b688-21bc0494f74b admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.744466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47797b65-5b6d-442f-b688-21bc0494f74b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:01.744770 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47797b65-5b6d-442f-b688-21bc0494f74b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.749333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361589f-3013-400c-ba88-85c1710cd356 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.750508 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47797b65-5b6d-442f-b688-21bc0494f74b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.760820 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ccf15-fb63-4a19-bb0c-23f2f8343088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.762892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ccf15-fb63-4a19-bb0c-23f2f8343088 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.763228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ccf15-fb63-4a19-bb0c-23f2f8343088 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.763502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ccf15-fb63-4a19-bb0c-23f2f8343088 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.773872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 304/595] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:01.778775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47797b65-5b6d-442f-b688-21bc0494f74b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.785423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ccf15-fb63-4a19-bb0c-23f2f8343088 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.788330 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ccf15-fb63-4a19-bb0c-23f2f8343088 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.794343 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47797b65-5b6d-442f-b688-21bc0494f74b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.807072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb6167-3c48-497d-bc12-b360fd40e43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.808083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb6167-3c48-497d-bc12-b360fd40e43f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.808382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb6167-3c48-497d-bc12-b360fd40e43f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.808640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb6167-3c48-497d-bc12-b360fd40e43f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.810002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb6167-3c48-497d-bc12-b360fd40e43f admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=6812bbce1050419ea721a9b648b87bef) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:01.810311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb6167-3c48-497d-bc12-b360fd40e43f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.812612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb6167-3c48-497d-bc12-b360fd40e43f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.826791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c44ccf15-fb63-4a19-bb0c-23f2f8343088 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:01.828344 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 292/596] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:01.829599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 305/597] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/role_assignments?user.id=6812bbce1050419ea721a9b648b87bef&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:01.840291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ccf15-fb63-4a19-bb0c-23f2f8343088 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.859513 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ccf15-fb63-4a19-bb0c-23f2f8343088 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.870177 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b215-4589-42f5-8ae9-751f41ee8a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.870874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b215-4589-42f5-8ae9-751f41ee8a28 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.871162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b215-4589-42f5-8ae9-751f41ee8a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.871446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b215-4589-42f5-8ae9-751f41ee8a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.872237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8b215-4589-42f5-8ae9-751f41ee8a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:01.872586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8b215-4589-42f5-8ae9-751f41ee8a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.874281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8b215-4589-42f5-8ae9-751f41ee8a28 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.892380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 293/598] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:01.899485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb6167-3c48-497d-bc12-b360fd40e43f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.911319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb6167-3c48-497d-bc12-b360fd40e43f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.921539 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e3861-c73b-4bb8-b32d-be011e2b20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.922450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3861-c73b-4bb8-b32d-be011e2b20fd admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.922732 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3861-c73b-4bb8-b32d-be011e2b20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.923008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3861-c73b-4bb8-b32d-be011e2b20fd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.934621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e3861-c73b-4bb8-b32d-be011e2b20fd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.936694 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e3861-c73b-4bb8-b32d-be011e2b20fd admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:01.951542 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-9e0e3861-c73b-4bb8-b32d-be011e2b20fd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:25:01.953392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 306/599] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:01.961244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b215-4589-42f5-8ae9-751f41ee8a28 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:01.984069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b215-4589-42f5-8ae9-751f41ee8a28 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:01.990356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ec73-4673-46ab-b9bc-1b19e172a61f None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.990356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ec73-4673-46ab-b9bc-1b19e172a61f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.992732 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ec73-4673-46ab-b9bc-1b19e172a61f None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.994293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 307/600] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:01.994468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1ef3-a8dd-4962-9457-c40a273b17eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:01.994965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1ef3-a8dd-4962-9457-c40a273b17eb admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:01.996397 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1ef3-a8dd-4962-9457-c40a273b17eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:01.996397 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1ef3-a8dd-4962-9457-c40a273b17eb admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:01.997985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f1ef3-a8dd-4962-9457-c40a273b17eb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:01.997985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f1ef3-a8dd-4962-9457-c40a273b17eb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:01.999596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f1ef3-a8dd-4962-9457-c40a273b17eb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.002277 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced18ec-3eb3-4e66-b667-f878826b4910 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.002479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced18ec-3eb3-4e66-b667-f878826b4910 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.002778 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced18ec-3eb3-4e66-b667-f878826b4910 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.005450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 308/601] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:02.007848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6fdc-55e6-4588-8f46-722030235e1f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.008139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6fdc-55e6-4588-8f46-722030235e1f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.008472 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6fdc-55e6-4588-8f46-722030235e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.028883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 294/602] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 04:25:01 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:02.030447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd6f04-d389-4a58-895e-56cc6da79b1e None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.030889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd6f04-d389-4a58-895e-56cc6da79b1e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.031317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd6f04-d389-4a58-895e-56cc6da79b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.034917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4a4d6fdc-55e6-4588-8f46-722030235e1f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:02.036071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4a4d6fdc-55e6-4588-8f46-722030235e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:02.048455 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 309/603] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:02.049599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d6fdc-55e6-4588-8f46-722030235e1f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.062477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-1fcd6f04-d389-4a58-895e-56cc6da79b1e None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:02.064135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1fcd6f04-d389-4a58-895e-56cc6da79b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:02.066398 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d6fdc-55e6-4588-8f46-722030235e1f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.072543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b489fe1-6ed3-4dd2-b4d2-53b75ebf856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.073392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b489fe1-6ed3-4dd2-b4d2-53b75ebf856a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.073678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b489fe1-6ed3-4dd2-b4d2-53b75ebf856a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.073959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b489fe1-6ed3-4dd2-b4d2-53b75ebf856a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.078268 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 295/604] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:02.079215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd6f04-d389-4a58-895e-56cc6da79b1e None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.084531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b489fe1-6ed3-4dd2-b4d2-53b75ebf856a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.086578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b489fe1-6ed3-4dd2-b4d2-53b75ebf856a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.099114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd6f04-d389-4a58-895e-56cc6da79b1e None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.104547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 310/605] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:02.105671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b489fe1-6ed3-4dd2-b4d2-53b75ebf856a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.113192 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468b1eb-433f-4a0e-b872-b7c2d17beec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.114003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b1eb-433f-4a0e-b872-b7c2d17beec2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.114287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b1eb-433f-4a0e-b872-b7c2d17beec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.114561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b1eb-433f-4a0e-b872-b7c2d17beec2 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.115295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468b1eb-433f-4a0e-b872-b7c2d17beec2 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.116469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-6468b1eb-433f-4a0e-b872-b7c2d17beec2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:02.116469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:25:02.116469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:25:02.117970 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468b1eb-433f-4a0e-b872-b7c2d17beec2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.120965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b489fe1-6ed3-4dd2-b4d2-53b75ebf856a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.126322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea6348-0787-4718-aa7c-5e2fda3d4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.127340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea6348-0787-4718-aa7c-5e2fda3d4eeb admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.127857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea6348-0787-4718-aa7c-5e2fda3d4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.128337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea6348-0787-4718-aa7c-5e2fda3d4eeb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.131963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-6468b1eb-433f-4a0e-b872-b7c2d17beec2 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:25:02.134085 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 296/606] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:02.134649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468b1eb-433f-4a0e-b872-b7c2d17beec2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.147886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea6348-0787-4718-aa7c-5e2fda3d4eeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.148540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468b1eb-433f-4a0e-b872-b7c2d17beec2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.150632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea6348-0787-4718-aa7c-5e2fda3d4eeb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.156164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f550dd-fda1-49fa-b01f-ea07b36b81f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.157237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f550dd-fda1-49fa-b01f-ea07b36b81f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.157622 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f550dd-fda1-49fa-b01f-ea07b36b81f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.157846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f550dd-fda1-49fa-b01f-ea07b36b81f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.174512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f550dd-fda1-49fa-b01f-ea07b36b81f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.174949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-20ea6348-0787-4718-aa7c-5e2fda3d4eeb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:02.176205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 311/607] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:02.177375 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f550dd-fda1-49fa-b01f-ea07b36b81f3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.181290 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea6348-0787-4718-aa7c-5e2fda3d4eeb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.198142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c7f550dd-fda1-49fa-b01f-ea07b36b81f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:02.200061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 297/608] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:02.201332 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f550dd-fda1-49fa-b01f-ea07b36b81f3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.203733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea6348-0787-4718-aa7c-5e2fda3d4eeb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.216150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c55cb-9b95-418d-bd94-d2ee124af6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.216921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c55cb-9b95-418d-bd94-d2ee124af6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.217211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c55cb-9b95-418d-bd94-d2ee124af6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.217512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c55cb-9b95-418d-bd94-d2ee124af6c4 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.218590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c55cb-9b95-418d-bd94-d2ee124af6c4 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:02.218590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c55cb-9b95-418d-bd94-d2ee124af6c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.220300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c55cb-9b95-418d-bd94-d2ee124af6c4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.221335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f550dd-fda1-49fa-b01f-ea07b36b81f3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.228511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 312/609] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/services?name=network => generated 124 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:02.229584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c55cb-9b95-418d-bd94-d2ee124af6c4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.231647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05c136-d79a-40ca-bc50-5e98d86f54a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.232304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05c136-d79a-40ca-bc50-5e98d86f54a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.232626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05c136-d79a-40ca-bc50-5e98d86f54a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.232901 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05c136-d79a-40ca-bc50-5e98d86f54a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.233664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05c136-d79a-40ca-bc50-5e98d86f54a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:02.233972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05c136-d79a-40ca-bc50-5e98d86f54a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.235647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05c136-d79a-40ca-bc50-5e98d86f54a2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.246553 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c55cb-9b95-418d-bd94-d2ee124af6c4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.252399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 298/610] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:02.252399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05c136-d79a-40ca-bc50-5e98d86f54a2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.258942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448fbf3-dcf6-4c34-8b7d-9acce34af089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.259776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448fbf3-dcf6-4c34-8b7d-9acce34af089 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.260516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448fbf3-dcf6-4c34-8b7d-9acce34af089 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.260516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448fbf3-dcf6-4c34-8b7d-9acce34af089 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.261419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448fbf3-dcf6-4c34-8b7d-9acce34af089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:02.261960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448fbf3-dcf6-4c34-8b7d-9acce34af089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.263703 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448fbf3-dcf6-4c34-8b7d-9acce34af089 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.264516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05c136-d79a-40ca-bc50-5e98d86f54a2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.269366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b0fb1-f0b0-412e-9fc3-5cc995ca4064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.270324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b0fb1-f0b0-412e-9fc3-5cc995ca4064 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.270754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b0fb1-f0b0-412e-9fc3-5cc995ca4064 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.271174 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b0fb1-f0b0-412e-9fc3-5cc995ca4064 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.272058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b0fb1-f0b0-412e-9fc3-5cc995ca4064 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:02.272615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b0fb1-f0b0-412e-9fc3-5cc995ca4064 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.274672 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b0fb1-f0b0-412e-9fc3-5cc995ca4064 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.281287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 299/611] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/services?type=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:02.282575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 313/612] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:02.282848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b0fb1-f0b0-412e-9fc3-5cc995ca4064 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.294482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b0fb1-f0b0-412e-9fc3-5cc995ca4064 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.295287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448fbf3-dcf6-4c34-8b7d-9acce34af089 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.299720 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65dddc-f200-4576-bd09-4399311efd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.300716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65dddc-f200-4576-bd09-4399311efd9e admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.301208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65dddc-f200-4576-bd09-4399311efd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.301689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65dddc-f200-4576-bd09-4399311efd9e admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.302637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65dddc-f200-4576-bd09-4399311efd9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.305435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65dddc-f200-4576-bd09-4399311efd9e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.311925 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448fbf3-dcf6-4c34-8b7d-9acce34af089 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.322594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74185da-804b-4510-b972-341af1f17395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.323403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74185da-804b-4510-b972-341af1f17395 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.323689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74185da-804b-4510-b972-341af1f17395 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.323966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74185da-804b-4510-b972-341af1f17395 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.337131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74185da-804b-4510-b972-341af1f17395 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.339395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74185da-804b-4510-b972-341af1f17395 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.355599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-a74185da-804b-4510-b972-341af1f17395 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:02.357262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 314/613] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:02.363943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74185da-804b-4510-b972-341af1f17395 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.374803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74185da-804b-4510-b972-341af1f17395 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.379877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27898b9-ffe5-467c-910c-75acfde2fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.380820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27898b9-ffe5-467c-910c-75acfde2fac1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.381158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27898b9-ffe5-467c-910c-75acfde2fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.381448 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27898b9-ffe5-467c-910c-75acfde2fac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.382952 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27898b9-ffe5-467c-910c-75acfde2fac1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:02.383300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27898b9-ffe5-467c-910c-75acfde2fac1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.385435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27898b9-ffe5-467c-910c-75acfde2fac1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.399534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 315/614] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:02.406584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27898b9-ffe5-467c-910c-75acfde2fac1 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:02.412689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 300/615] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:25:02 2021] POST /identity/v3/users => generated 254 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:02.420756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27898b9-ffe5-467c-910c-75acfde2fac1 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:02.427712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfabf0-eab6-4191-bcb6-79fdb514a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:02.428457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfabf0-eab6-4191-bcb6-79fdb514a65d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:02.428844 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfabf0-eab6-4191-bcb6-79fdb514a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:02.429356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfabf0-eab6-4191-bcb6-79fdb514a65d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:02.430266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfabf0-eab6-4191-bcb6-79fdb514a65d admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=c23aad5d62b84cd7a4da788500148f7e) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:02.430590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfabf0-eab6-4191-bcb6-79fdb514a65d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:02.432694 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfabf0-eab6-4191-bcb6-79fdb514a65d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:02.446527 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 316/616] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:02 2021] GET /identity/v3/role_assignments?user.id=c23aad5d62b84cd7a4da788500148f7e&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:03.339237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e4bb5-11c5-4bc3-9600-58c447f10c18 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:03.340250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e4bb5-11c5-4bc3-9600-58c447f10c18 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:03.340769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e4bb5-11c5-4bc3-9600-58c447f10c18 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:03.343091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 301/617] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:03.354610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b20a3-ef0c-4a16-865d-873a53359708 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:03.355515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b20a3-ef0c-4a16-865d-873a53359708 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:03.355997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b20a3-ef0c-4a16-865d-873a53359708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:03.381368 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-615b20a3-ef0c-4a16-865d-873a53359708 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:03.383560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-615b20a3-ef0c-4a16-865d-873a53359708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:03.391646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 317/618] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:03.415550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e4bb5-11c5-4bc3-9600-58c447f10c18 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:03.429989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e4bb5-11c5-4bc3-9600-58c447f10c18 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:03.439963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1bfe6-d3f2-4393-9a20-ceb4c4a9313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:03.440990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1bfe6-d3f2-4393-9a20-ceb4c4a9313c admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:03.441477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1bfe6-d3f2-4393-9a20-ceb4c4a9313c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:03.441952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1bfe6-d3f2-4393-9a20-ceb4c4a9313c admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:03.442884 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1bfe6-d3f2-4393-9a20-ceb4c4a9313c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:03.444100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-49b1bfe6-d3f2-4393-9a20-ceb4c4a9313c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:03.444100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:25:03.444100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:25:03.445525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1bfe6-d3f2-4393-9a20-ceb4c4a9313c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:03.575893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 302/619] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:25:03 2021] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:04.410162 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72574-1b2f-49af-a30c-01ccd392e4e1 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.411166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72574-1b2f-49af-a30c-01ccd392e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.411680 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72574-1b2f-49af-a30c-01ccd392e4e1 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.413772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 318/620] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:04.422010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309a9b3-f635-477a-a8fe-cbc54ad54538 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.422881 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309a9b3-f635-477a-a8fe-cbc54ad54538 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.423362 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309a9b3-f635-477a-a8fe-cbc54ad54538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.447391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-6309a9b3-f635-477a-a8fe-cbc54ad54538 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:04.448612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6309a9b3-f635-477a-a8fe-cbc54ad54538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:04.472148 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 303/621] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:04 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:04.507612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72574-1b2f-49af-a30c-01ccd392e4e1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:04.526791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72574-1b2f-49af-a30c-01ccd392e4e1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:04.536006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee9d0f-118c-4cf0-895c-9ebb5d141967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:04.537075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee9d0f-118c-4cf0-895c-9ebb5d141967 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.537577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee9d0f-118c-4cf0-895c-9ebb5d141967 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.538050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee9d0f-118c-4cf0-895c-9ebb5d141967 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.557288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee9d0f-118c-4cf0-895c-9ebb5d141967 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:04.564381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-1fee9d0f-118c-4cf0-895c-9ebb5d141967 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:25:04.566183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 319/622] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:04.573134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309a9b3-f635-477a-a8fe-cbc54ad54538 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:04.585387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309a9b3-f635-477a-a8fe-cbc54ad54538 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:04.592436 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a56e46-9098-47d0-b9f5-e0fc45ad06af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:04.593098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a56e46-9098-47d0-b9f5-e0fc45ad06af admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.593386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a56e46-9098-47d0-b9f5-e0fc45ad06af admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.593661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a56e46-9098-47d0-b9f5-e0fc45ad06af admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.594503 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a56e46-9098-47d0-b9f5-e0fc45ad06af admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:04.594807 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a56e46-9098-47d0-b9f5-e0fc45ad06af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:04.596415 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a56e46-9098-47d0-b9f5-e0fc45ad06af admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:04.610973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 304/623] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:04.616860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee9d0f-118c-4cf0-895c-9ebb5d141967 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:04.629381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee9d0f-118c-4cf0-895c-9ebb5d141967 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:04.636512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37d019-c7a5-4701-baf0-8efa1f6e6cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:04.637307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37d019-c7a5-4701-baf0-8efa1f6e6cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.637589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37d019-c7a5-4701-baf0-8efa1f6e6cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.637861 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37d019-c7a5-4701-baf0-8efa1f6e6cd8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.653497 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37d019-c7a5-4701-baf0-8efa1f6e6cd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:04.655352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37d019-c7a5-4701-baf0-8efa1f6e6cd8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:04.686295 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-aa37d019-c7a5-4701-baf0-8efa1f6e6cd8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:04.687768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 320/624] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:04.699337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a56e46-9098-47d0-b9f5-e0fc45ad06af admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:04.715994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a56e46-9098-47d0-b9f5-e0fc45ad06af admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:04.725135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4d25d-62d8-4997-8d49-a440c5f9363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:04.725917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4d25d-62d8-4997-8d49-a440c5f9363d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.726819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4d25d-62d8-4997-8d49-a440c5f9363d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.727175 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4d25d-62d8-4997-8d49-a440c5f9363d admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.727990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4d25d-62d8-4997-8d49-a440c5f9363d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:04.728399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4d25d-62d8-4997-8d49-a440c5f9363d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:04.730100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4d25d-62d8-4997-8d49-a440c5f9363d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:04.750081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 305/625] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:04.756054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37d019-c7a5-4701-baf0-8efa1f6e6cd8 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:04.770706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37d019-c7a5-4701-baf0-8efa1f6e6cd8 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:04.778300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213d843-cbca-4664-aa80-c2e4b2628aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:04.779341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213d843-cbca-4664-aa80-c2e4b2628aae admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.779822 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213d843-cbca-4664-aa80-c2e4b2628aae admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.780295 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213d843-cbca-4664-aa80-c2e4b2628aae admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.797567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213d843-cbca-4664-aa80-c2e4b2628aae admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:04.799915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213d843-cbca-4664-aa80-c2e4b2628aae admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:04.817839 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-3213d843-cbca-4664-aa80-c2e4b2628aae admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:25:04.819695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 321/626] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 04:25:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:04.826718 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4d25d-62d8-4997-8d49-a440c5f9363d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:04.839788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4d25d-62d8-4997-8d49-a440c5f9363d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:04.844862 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc8c8c-e660-4554-b23b-d062fb6b6754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:04.845750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc8c8c-e660-4554-b23b-d062fb6b6754 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.846229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc8c8c-e660-4554-b23b-d062fb6b6754 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.846694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc8c8c-e660-4554-b23b-d062fb6b6754 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.847742 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc8c8c-e660-4554-b23b-d062fb6b6754 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:04.848242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc8c8c-e660-4554-b23b-d062fb6b6754 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:04.850313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc8c8c-e660-4554-b23b-d062fb6b6754 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:04.869525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 306/627] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 04:25:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:04.876201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213d843-cbca-4664-aa80-c2e4b2628aae admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:04.887833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213d843-cbca-4664-aa80-c2e4b2628aae admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:04.893386 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834523c-4bb1-4071-9534-3bc62d3036e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:04.894636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834523c-4bb1-4071-9534-3bc62d3036e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.895122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834523c-4bb1-4071-9534-3bc62d3036e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.895646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834523c-4bb1-4071-9534-3bc62d3036e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.913349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834523c-4bb1-4071-9534-3bc62d3036e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:04.915693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834523c-4bb1-4071-9534-3bc62d3036e2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:04.936028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-1834523c-4bb1-4071-9534-3bc62d3036e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:04.937956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 322/628] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:04.944280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc8c8c-e660-4554-b23b-d062fb6b6754 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:04.954620 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc8c8c-e660-4554-b23b-d062fb6b6754 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:04.959704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f76298-a97e-4ec1-8e7a-7b6336c99466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:04.961526 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f76298-a97e-4ec1-8e7a-7b6336c99466 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.962031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f76298-a97e-4ec1-8e7a-7b6336c99466 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.962509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f76298-a97e-4ec1-8e7a-7b6336c99466 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.963479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f76298-a97e-4ec1-8e7a-7b6336c99466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:04.963585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b474c-b29d-4665-b9b6-a0aa3fb756bc None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.963843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b474c-b29d-4665-b9b6-a0aa3fb756bc None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.964112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b474c-b29d-4665-b9b6-a0aa3fb756bc None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.964551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f76298-a97e-4ec1-8e7a-7b6336c99466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:04.966211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 323/629] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:04.966652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f76298-a97e-4ec1-8e7a-7b6336c99466 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:04.973048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f08c2-deb0-4df2-928e-8bbed5167f2b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:04.973344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f08c2-deb0-4df2-928e-8bbed5167f2b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:04.973631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f08c2-deb0-4df2-928e-8bbed5167f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:04.980073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 307/630] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:04.986330 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f76298-a97e-4ec1-8e7a-7b6336c99466 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:04.995805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-700f08c2-deb0-4df2-928e-8bbed5167f2b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:04.997040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-700f08c2-deb0-4df2-928e-8bbed5167f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:04.997823 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f76298-a97e-4ec1-8e7a-7b6336c99466 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.002743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ba05-0916-4faa-800c-a03528fe6b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.003849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ba05-0916-4faa-800c-a03528fe6b12 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.004328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ba05-0916-4faa-800c-a03528fe6b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.004928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ba05-0916-4faa-800c-a03528fe6b12 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.005566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 324/631] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:04 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:05.014242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2ba05-0916-4faa-800c-a03528fe6b12 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.016622 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2ba05-0916-4faa-800c-a03528fe6b12 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.029628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f08c2-deb0-4df2-928e-8bbed5167f2b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.031468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c3a2ba05-0916-4faa-800c-a03528fe6b12 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:05.033191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 308/632] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:05.039119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f08c2-deb0-4df2-928e-8bbed5167f2b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.039927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ba05-0916-4faa-800c-a03528fe6b12 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.044180 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd854a-e8fd-44ac-8bce-e310f4120724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.044862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd854a-e8fd-44ac-8bce-e310f4120724 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.045149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd854a-e8fd-44ac-8bce-e310f4120724 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.045429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd854a-e8fd-44ac-8bce-e310f4120724 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.046160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd854a-e8fd-44ac-8bce-e310f4120724 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.047167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-9fcd854a-e8fd-44ac-8bce-e310f4120724 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:05.047167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:25:05.047167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:25:05.048594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd854a-e8fd-44ac-8bce-e310f4120724 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.052246 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ba05-0916-4faa-800c-a03528fe6b12 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.061754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc7faa-c7f3-492c-93b7-b4d27097b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.062759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc7faa-c7f3-492c-93b7-b4d27097b376 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.063288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc7faa-c7f3-492c-93b7-b4d27097b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.063769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc7faa-c7f3-492c-93b7-b4d27097b376 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.064917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc7faa-c7f3-492c-93b7-b4d27097b376 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:05.065414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc7faa-c7f3-492c-93b7-b4d27097b376 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.067604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc7faa-c7f3-492c-93b7-b4d27097b376 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.080979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 309/633] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:05.088310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc7faa-c7f3-492c-93b7-b4d27097b376 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.098616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc7faa-c7f3-492c-93b7-b4d27097b376 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.103677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61d7c7-03ef-4ff9-84dd-8c0cf9de563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.104845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61d7c7-03ef-4ff9-84dd-8c0cf9de563e admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.105303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61d7c7-03ef-4ff9-84dd-8c0cf9de563e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.105754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61d7c7-03ef-4ff9-84dd-8c0cf9de563e admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/6812bbce1050419ea721a9b648b87bef/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.108003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61d7c7-03ef-4ff9-84dd-8c0cf9de563e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=6812bbce1050419ea721a9b648b87bef, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.111065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61d7c7-03ef-4ff9-84dd-8c0cf9de563e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.125938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 325/634] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:25:05 2021] POST /identity/v3/services => generated 240 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:05.181066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 310/635] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:25:05 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/6812bbce1050419ea721a9b648b87bef/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:25:05.283155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a44d1-40c4-4bc4-98f2-55cef9f18f4c None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.283352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a44d1-40c4-4bc4-98f2-55cef9f18f4c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.283600 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a44d1-40c4-4bc4-98f2-55cef9f18f4c None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.285860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 326/636] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:05.293621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bbe28-cacb-41c0-84a1-2f23fac31cdc None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.293966 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bbe28-cacb-41c0-84a1-2f23fac31cdc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.294171 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bbe28-cacb-41c0-84a1-2f23fac31cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.323273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-244bbe28-cacb-41c0-84a1-2f23fac31cdc None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:05.324531 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-244bbe28-cacb-41c0-84a1-2f23fac31cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:05.373605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab58bd-03e1-4329-9c8a-c7b18b59d856 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.373914 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab58bd-03e1-4329-9c8a-c7b18b59d856 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.374168 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab58bd-03e1-4329-9c8a-c7b18b59d856 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.377566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 327/637] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:05.383465 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4351e-a049-4b64-853b-ad34376d217a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.384049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4351e-a049-4b64-853b-ad34376d217a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.384597 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4351e-a049-4b64-853b-ad34376d217a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.400524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 311/638] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:05 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:05.418314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-98a4351e-a049-4b64-853b-ad34376d217a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:05.419820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-98a4351e-a049-4b64-853b-ad34376d217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:05.432607 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 328/639] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:05 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:05.436005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bbe28-cacb-41c0-84a1-2f23fac31cdc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.445355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bbe28-cacb-41c0-84a1-2f23fac31cdc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.449953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c316-b41c-44a5-9c9e-db8dbe1b5130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.450765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c316-b41c-44a5-9c9e-db8dbe1b5130 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.451041 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c316-b41c-44a5-9c9e-db8dbe1b5130 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.451308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c316-b41c-44a5-9c9e-db8dbe1b5130 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.458646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4351e-a049-4b64-853b-ad34376d217a None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.463115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58c316-b41c-44a5-9c9e-db8dbe1b5130 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:05.470314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4351e-a049-4b64-853b-ad34376d217a None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.471425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-ec58c316-b41c-44a5-9c9e-db8dbe1b5130 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:25:05.473080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 312/640] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:05.481833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c316-b41c-44a5-9c9e-db8dbe1b5130 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.482775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22dbe5-cb29-401c-b393-ac5e8cd747e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.483713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22dbe5-cb29-401c-b393-ac5e8cd747e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.484077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22dbe5-cb29-401c-b393-ac5e8cd747e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.484436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22dbe5-cb29-401c-b393-ac5e8cd747e8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.496788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22dbe5-cb29-401c-b393-ac5e8cd747e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:05.499595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c316-b41c-44a5-9c9e-db8dbe1b5130 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.503941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-fd22dbe5-cb29-401c-b393-ac5e8cd747e8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:25:05.505935 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 329/641] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:05.514049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22dbe5-cb29-401c-b393-ac5e8cd747e8 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.517379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b61a3-12a4-453b-af1f-1f4d5456f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.518154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b61a3-12a4-453b-af1f-1f4d5456f38c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.518433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b61a3-12a4-453b-af1f-1f4d5456f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.518708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b61a3-12a4-453b-af1f-1f4d5456f38c admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.521029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b61a3-12a4-453b-af1f-1f4d5456f38c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:05.521338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b61a3-12a4-453b-af1f-1f4d5456f38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.524993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b61a3-12a4-453b-af1f-1f4d5456f38c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.536135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22dbe5-cb29-401c-b393-ac5e8cd747e8 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.545186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0fdf7-07ad-4abd-934f-4ed6b069f6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.545713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 313/642] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:05.546044 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0fdf7-07ad-4abd-934f-4ed6b069f6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.546338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0fdf7-07ad-4abd-934f-4ed6b069f6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.546679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0fdf7-07ad-4abd-934f-4ed6b069f6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.547524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0fdf7-07ad-4abd-934f-4ed6b069f6f9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:05.547839 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0fdf7-07ad-4abd-934f-4ed6b069f6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.549528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0fdf7-07ad-4abd-934f-4ed6b069f6f9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.551687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b61a3-12a4-453b-af1f-1f4d5456f38c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.567428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b61a3-12a4-453b-af1f-1f4d5456f38c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.573838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 330/643] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:05.576270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af9917-2cc8-4106-87e2-c40efe52818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.577132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af9917-2cc8-4106-87e2-c40efe52818b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.577412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af9917-2cc8-4106-87e2-c40efe52818b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.577685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af9917-2cc8-4106-87e2-c40efe52818b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.580088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0fdf7-07ad-4abd-934f-4ed6b069f6f9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.590734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0fdf7-07ad-4abd-934f-4ed6b069f6f9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.597981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af9917-2cc8-4106-87e2-c40efe52818b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.600087 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af9917-2cc8-4106-87e2-c40efe52818b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.602207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7731b2-57f8-4837-8f65-5cc42a038542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.605526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7731b2-57f8-4837-8f65-5cc42a038542 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.611029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7731b2-57f8-4837-8f65-5cc42a038542 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.611546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7731b2-57f8-4837-8f65-5cc42a038542 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.629121 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-75af9917-2cc8-4106-87e2-c40efe52818b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:05.633627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7731b2-57f8-4837-8f65-5cc42a038542 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.635771 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7731b2-57f8-4837-8f65-5cc42a038542 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.638564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 314/644] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:05.645241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af9917-2cc8-4106-87e2-c40efe52818b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.661703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af9917-2cc8-4106-87e2-c40efe52818b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.670049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-4e7731b2-57f8-4837-8f65-5cc42a038542 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:05.673017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425474a6-a592-4526-9b90-b9404f1581b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.673783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425474a6-a592-4526-9b90-b9404f1581b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.674066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425474a6-a592-4526-9b90-b9404f1581b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.674342 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425474a6-a592-4526-9b90-b9404f1581b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.675130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425474a6-a592-4526-9b90-b9404f1581b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:05.675435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425474a6-a592-4526-9b90-b9404f1581b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.675937 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 331/645] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:05.677219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425474a6-a592-4526-9b90-b9404f1581b0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.678135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7731b2-57f8-4837-8f65-5cc42a038542 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.697082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7731b2-57f8-4837-8f65-5cc42a038542 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.700791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 315/646] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:05.707708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425474a6-a592-4526-9b90-b9404f1581b0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.713308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd84e14-7704-435b-8063-3602c07f17f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.714035 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd84e14-7704-435b-8063-3602c07f17f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.714318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd84e14-7704-435b-8063-3602c07f17f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.714599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd84e14-7704-435b-8063-3602c07f17f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.716126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd84e14-7704-435b-8063-3602c07f17f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:05.718005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd84e14-7704-435b-8063-3602c07f17f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.719902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd84e14-7704-435b-8063-3602c07f17f9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.730331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425474a6-a592-4526-9b90-b9404f1581b0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.738153 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fe513-d78d-4473-8a30-f48399c0994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.739059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe513-d78d-4473-8a30-f48399c0994f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.739340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe513-d78d-4473-8a30-f48399c0994f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.739616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe513-d78d-4473-8a30-f48399c0994f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.740997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 332/647] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:05.747835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd84e14-7704-435b-8063-3602c07f17f9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.758350 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fe513-d78d-4473-8a30-f48399c0994f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.760981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fe513-d78d-4473-8a30-f48399c0994f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.764655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd84e14-7704-435b-8063-3602c07f17f9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.771716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b2d2e-0a39-4338-abc7-1b0a716e727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.772544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2d2e-0a39-4338-abc7-1b0a716e727f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.772828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2d2e-0a39-4338-abc7-1b0a716e727f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.773126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2d2e-0a39-4338-abc7-1b0a716e727f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.778200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-209fe513-d78d-4473-8a30-f48399c0994f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:25:05.779819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 316/648] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:05.785806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fe513-d78d-4473-8a30-f48399c0994f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.787490 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b2d2e-0a39-4338-abc7-1b0a716e727f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.789576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b2d2e-0a39-4338-abc7-1b0a716e727f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.799794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fe513-d78d-4473-8a30-f48399c0994f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.803685 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-1d7b2d2e-0a39-4338-abc7-1b0a716e727f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:25:05.805922 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 333/649] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:05.812313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b2d2e-0a39-4338-abc7-1b0a716e727f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.819451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c4c35-38fc-4097-b2ec-db7b7a55abb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.820685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c4c35-38fc-4097-b2ec-db7b7a55abb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.820961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c4c35-38fc-4097-b2ec-db7b7a55abb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.821232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c4c35-38fc-4097-b2ec-db7b7a55abb1 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.822066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c4c35-38fc-4097-b2ec-db7b7a55abb1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:05.822367 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c4c35-38fc-4097-b2ec-db7b7a55abb1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.824209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c4c35-38fc-4097-b2ec-db7b7a55abb1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.830641 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b2d2e-0a39-4338-abc7-1b0a716e727f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.840786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be308e4-0c15-4f9c-bf49-d420ea4b17e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.841436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be308e4-0c15-4f9c-bf49-d420ea4b17e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.841716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be308e4-0c15-4f9c-bf49-d420ea4b17e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.841986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be308e4-0c15-4f9c-bf49-d420ea4b17e1 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.842809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be308e4-0c15-4f9c-bf49-d420ea4b17e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:05.843109 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be308e4-0c15-4f9c-bf49-d420ea4b17e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.844958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be308e4-0c15-4f9c-bf49-d420ea4b17e1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.863295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 317/650] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:05.871954 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c4c35-38fc-4097-b2ec-db7b7a55abb1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.880329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 334/651] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:05.887315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be308e4-0c15-4f9c-bf49-d420ea4b17e1 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.890537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c4c35-38fc-4097-b2ec-db7b7a55abb1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.896247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a15c2c-f0e6-4f87-b441-4324f622f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.896910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15c2c-f0e6-4f87-b441-4324f622f3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.897187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15c2c-f0e6-4f87-b441-4324f622f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.897455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15c2c-f0e6-4f87-b441-4324f622f3a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.898304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be308e4-0c15-4f9c-bf49-d420ea4b17e1 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.910298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58ea0c-ffc0-4d25-8e42-9436439e2183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.911197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ea0c-ffc0-4d25-8e42-9436439e2183 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.911680 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ea0c-ffc0-4d25-8e42-9436439e2183 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.912153 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ea0c-ffc0-4d25-8e42-9436439e2183 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.913650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a15c2c-f0e6-4f87-b441-4324f622f3a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.916014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a15c2c-f0e6-4f87-b441-4324f622f3a1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.929742 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58ea0c-ffc0-4d25-8e42-9436439e2183 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.931803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58ea0c-ffc0-4d25-8e42-9436439e2183 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:05.934681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 318/652] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:25:05.940865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a15c2c-f0e6-4f87-b441-4324f622f3a1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.952050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 335/653] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:25:05.959036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a15c2c-f0e6-4f87-b441-4324f622f3a1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.965167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58ea0c-ffc0-4d25-8e42-9436439e2183 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:05.972438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff2a9f-4427-4096-8642-fcef3b6d5766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.973668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2a9f-4427-4096-8642-fcef3b6d5766 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.975812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58ea0c-ffc0-4d25-8e42-9436439e2183 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:05.976340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2a9f-4427-4096-8642-fcef3b6d5766 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.976841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2a9f-4427-4096-8642-fcef3b6d5766 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.989402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36df9d-4b47-4390-a74f-7ac95a9d68cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:05.990452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36df9d-4b47-4390-a74f-7ac95a9d68cc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:05.990935 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36df9d-4b47-4390-a74f-7ac95a9d68cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:05.991421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36df9d-4b47-4390-a74f-7ac95a9d68cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:05.995657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff2a9f-4427-4096-8642-fcef3b6d5766 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:05.998439 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff2a9f-4427-4096-8642-fcef3b6d5766 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.012477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36df9d-4b47-4390-a74f-7ac95a9d68cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.014629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36df9d-4b47-4390-a74f-7ac95a9d68cc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.032322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-9eff2a9f-4427-4096-8642-fcef3b6d5766 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:06.036833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 319/654] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:06.045619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-3f36df9d-4b47-4390-a74f-7ac95a9d68cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:06.046766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff2a9f-4427-4096-8642-fcef3b6d5766 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.052396 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 336/655] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:06.058720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36df9d-4b47-4390-a74f-7ac95a9d68cc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.062993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff2a9f-4427-4096-8642-fcef3b6d5766 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.067738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690d405-b63c-4e47-9485-c42f0e6fb9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.068517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690d405-b63c-4e47-9485-c42f0e6fb9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.068870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690d405-b63c-4e47-9485-c42f0e6fb9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.069229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690d405-b63c-4e47-9485-c42f0e6fb9f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.070661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690d405-b63c-4e47-9485-c42f0e6fb9f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:06.071120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690d405-b63c-4e47-9485-c42f0e6fb9f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.073208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690d405-b63c-4e47-9485-c42f0e6fb9f8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.075143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36df9d-4b47-4390-a74f-7ac95a9d68cc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.084372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02623554-e10e-4e84-95f5-893aed7dc903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.085099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02623554-e10e-4e84-95f5-893aed7dc903 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.085966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02623554-e10e-4e84-95f5-893aed7dc903 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.086297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02623554-e10e-4e84-95f5-893aed7dc903 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.086943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 320/656] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:06.087061 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02623554-e10e-4e84-95f5-893aed7dc903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:06.087371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02623554-e10e-4e84-95f5-893aed7dc903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.094147 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02623554-e10e-4e84-95f5-893aed7dc903 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.096459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690d405-b63c-4e47-9485-c42f0e6fb9f8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.106778 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 337/657] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:06.112841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02623554-e10e-4e84-95f5-893aed7dc903 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.115236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690d405-b63c-4e47-9485-c42f0e6fb9f8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.123475 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02623554-e10e-4e84-95f5-893aed7dc903 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.125539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550b257-ccb5-4ba1-9e01-d0ecc2aa4d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.126599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b257-ccb5-4ba1-9e01-d0ecc2aa4d6a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.127029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b257-ccb5-4ba1-9e01-d0ecc2aa4d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.127612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b257-ccb5-4ba1-9e01-d0ecc2aa4d6a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.128843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90723104-fba1-4a97-961f-328ff4f9c618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.129776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90723104-fba1-4a97-961f-328ff4f9c618 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.130164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90723104-fba1-4a97-961f-328ff4f9c618 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.130582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90723104-fba1-4a97-961f-328ff4f9c618 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.139095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90723104-fba1-4a97-961f-328ff4f9c618 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.141273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90723104-fba1-4a97-961f-328ff4f9c618 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.144126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550b257-ccb5-4ba1-9e01-d0ecc2aa4d6a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.146223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550b257-ccb5-4ba1-9e01-d0ecc2aa4d6a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.159900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-90723104-fba1-4a97-961f-328ff4f9c618 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:06.165430 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-9550b257-ccb5-4ba1-9e01-d0ecc2aa4d6a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:06.167213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 321/658] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:06.172430 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 338/659] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:06.178943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550b257-ccb5-4ba1-9e01-d0ecc2aa4d6a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.179099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90723104-fba1-4a97-961f-328ff4f9c618 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.190320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550b257-ccb5-4ba1-9e01-d0ecc2aa4d6a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.194541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90723104-fba1-4a97-961f-328ff4f9c618 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.203089 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2c45d-973c-4c86-8ef2-a37110c013d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.203755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2c45d-973c-4c86-8ef2-a37110c013d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.204032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2c45d-973c-4c86-8ef2-a37110c013d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.204302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2c45d-973c-4c86-8ef2-a37110c013d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.205121 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2c45d-973c-4c86-8ef2-a37110c013d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:06.205421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2c45d-973c-4c86-8ef2-a37110c013d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.207281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2c45d-973c-4c86-8ef2-a37110c013d4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.211523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683fc9-7698-4445-94b3-884d9b63ae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.212177 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683fc9-7698-4445-94b3-884d9b63ae22 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.212479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683fc9-7698-4445-94b3-884d9b63ae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.212752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683fc9-7698-4445-94b3-884d9b63ae22 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.213530 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80683fc9-7698-4445-94b3-884d9b63ae22 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:06.213830 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80683fc9-7698-4445-94b3-884d9b63ae22 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.215642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80683fc9-7698-4445-94b3-884d9b63ae22 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.237602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 339/660] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:06.237812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 322/661] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:06.243994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683fc9-7698-4445-94b3-884d9b63ae22 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.249801 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2c45d-973c-4c86-8ef2-a37110c013d4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.263046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2c45d-973c-4c86-8ef2-a37110c013d4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.263911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683fc9-7698-4445-94b3-884d9b63ae22 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.270859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef80ea5-b3b3-405e-9802-1de10e06529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.271507 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80ea5-b3b3-405e-9802-1de10e06529d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.271785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80ea5-b3b3-405e-9802-1de10e06529d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.272057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80ea5-b3b3-405e-9802-1de10e06529d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.274222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b169553-f0a2-45a8-9dd4-e301befc23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.274863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b169553-f0a2-45a8-9dd4-e301befc23fe admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.275140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b169553-f0a2-45a8-9dd4-e301befc23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.275408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b169553-f0a2-45a8-9dd4-e301befc23fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.276230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b169553-f0a2-45a8-9dd4-e301befc23fe admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=c23aad5d62b84cd7a4da788500148f7e) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:06.276560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b169553-f0a2-45a8-9dd4-e301befc23fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.278404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b169553-f0a2-45a8-9dd4-e301befc23fe admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.280741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef80ea5-b3b3-405e-9802-1de10e06529d admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=36d3a6eb24b04e14a42d771c9c768ed2) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:06.281054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef80ea5-b3b3-405e-9802-1de10e06529d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.282896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef80ea5-b3b3-405e-9802-1de10e06529d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.290755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 323/662] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/role_assignments?user.id=36d3a6eb24b04e14a42d771c9c768ed2&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:06.291757 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 340/663] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/role_assignments?user.id=c23aad5d62b84cd7a4da788500148f7e&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:06.557451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b1fcb-0d7d-4fe5-8d9c-dec5896220cc None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.558092 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b1fcb-0d7d-4fe5-8d9c-dec5896220cc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.558210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b1fcb-0d7d-4fe5-8d9c-dec5896220cc None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.560282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 324/664] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:06.567588 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e4b78-8916-40c2-ab85-f1ab8b6da7bd None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.568229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e4b78-8916-40c2-ab85-f1ab8b6da7bd None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.568229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e4b78-8916-40c2-ab85-f1ab8b6da7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.597196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-5a0e4b78-8916-40c2-ab85-f1ab8b6da7bd None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:06.598428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5a0e4b78-8916-40c2-ab85-f1ab8b6da7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:06.611502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 341/665] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:06 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:06.635571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b1fcb-0d7d-4fe5-8d9c-dec5896220cc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.651950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b1fcb-0d7d-4fe5-8d9c-dec5896220cc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.660021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aee26-aa6b-47ef-8fa6-dbd944462376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.660867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aee26-aa6b-47ef-8fa6-dbd944462376 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.661232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aee26-aa6b-47ef-8fa6-dbd944462376 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.661503 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aee26-aa6b-47ef-8fa6-dbd944462376 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.662167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2aee26-aa6b-47ef-8fa6-dbd944462376 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.664375 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2aee26-aa6b-47ef-8fa6-dbd944462376 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.684725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-7c2aee26-aa6b-47ef-8fa6-dbd944462376 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:25:06.686294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 325/666] 10.222.0.25 () {56 vars in 1151 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:06.696096 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e4b78-8916-40c2-ab85-f1ab8b6da7bd None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.711243 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e4b78-8916-40c2-ab85-f1ab8b6da7bd None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.716154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1669207-bb62-4b22-b5e6-9db44c564fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.717084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1669207-bb62-4b22-b5e6-9db44c564fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.717539 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1669207-bb62-4b22-b5e6-9db44c564fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.717984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1669207-bb62-4b22-b5e6-9db44c564fb5 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.718874 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1669207-bb62-4b22-b5e6-9db44c564fb5 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:06.719368 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1669207-bb62-4b22-b5e6-9db44c564fb5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.721171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1669207-bb62-4b22-b5e6-9db44c564fb5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.732699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 342/667] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:06.738818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aee26-aa6b-47ef-8fa6-dbd944462376 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.753481 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aee26-aa6b-47ef-8fa6-dbd944462376 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.763429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab957e-950a-4de0-998f-085cd2e62896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.764494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab957e-950a-4de0-998f-085cd2e62896 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.764994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab957e-950a-4de0-998f-085cd2e62896 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.765463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab957e-950a-4de0-998f-085cd2e62896 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.766375 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab957e-950a-4de0-998f-085cd2e62896 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:06.766875 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab957e-950a-4de0-998f-085cd2e62896 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.768714 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab957e-950a-4de0-998f-085cd2e62896 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.777531 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 326/668] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:06.783871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1669207-bb62-4b22-b5e6-9db44c564fb5 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.797684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1669207-bb62-4b22-b5e6-9db44c564fb5 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.804811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56645699-497f-4397-9939-07ae85e323f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.805492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56645699-497f-4397-9939-07ae85e323f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.805776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56645699-497f-4397-9939-07ae85e323f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.806051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56645699-497f-4397-9939-07ae85e323f6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.806846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56645699-497f-4397-9939-07ae85e323f6 admin admin] RBAC: Adding query filter params (interface=public, service_id=8e9c3e4d27594cb3a73701a900346a63, region_id=RegionOne) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:06.807155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56645699-497f-4397-9939-07ae85e323f6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.808240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-56645699-497f-4397-9939-07ae85e323f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:06.808240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:25:06.808240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:25:06.809175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56645699-497f-4397-9939-07ae85e323f6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.824646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 343/669] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/endpoints?service_id=8e9c3e4d27594cb3a73701a900346a63&interface=public®ion_id=RegionOne => generated 194 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:06.830739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab957e-950a-4de0-998f-085cd2e62896 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:06.845242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab957e-950a-4de0-998f-085cd2e62896 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:06.852434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a2c17-49ef-4ca7-a88a-ea2175b85f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:06.853161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2c17-49ef-4ca7-a88a-ea2175b85f8f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:06.853511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2c17-49ef-4ca7-a88a-ea2175b85f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:06.853854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2c17-49ef-4ca7-a88a-ea2175b85f8f admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:06.854597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a2c17-49ef-4ca7-a88a-ea2175b85f8f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:06.856262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a2c17-49ef-4ca7-a88a-ea2175b85f8f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:06.865743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 327/670] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:25:06 2021] GET /identity/v3/services => generated 772 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:07.748606 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf99c06-5186-441e-ab93-b32cb0662006 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:07.749602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf99c06-5186-441e-ab93-b32cb0662006 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:07.750083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf99c06-5186-441e-ab93-b32cb0662006 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:07.752438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 344/671] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:07.758519 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4177d-748f-4144-8648-ab1a23a77e6c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:07.759024 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4177d-748f-4144-8648-ab1a23a77e6c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:07.759150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4177d-748f-4144-8648-ab1a23a77e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:07.785582 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-abd4177d-748f-4144-8648-ab1a23a77e6c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:07.786800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-abd4177d-748f-4144-8648-ab1a23a77e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:07.802332 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 328/672] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:07 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:07.851724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf99c06-5186-441e-ab93-b32cb0662006 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:07.867913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf99c06-5186-441e-ab93-b32cb0662006 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:07.876345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c65a-520f-4189-a8c6-1b9ebf0c6985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:07.877475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49badca2-55b6-49db-8481-193ba334afee None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:07.877768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49badca2-55b6-49db-8481-193ba334afee None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:07.877873 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c65a-520f-4189-a8c6-1b9ebf0c6985 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:07.878043 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49badca2-55b6-49db-8481-193ba334afee None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:07.878509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c65a-520f-4189-a8c6-1b9ebf0c6985 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:07.879009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c65a-520f-4189-a8c6-1b9ebf0c6985 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:07.880103 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 329/673] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:07.886015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660588c5-1b16-4554-82dd-2507428929e4 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:07.886322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660588c5-1b16-4554-82dd-2507428929e4 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:07.886576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660588c5-1b16-4554-82dd-2507428929e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:07.894479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6c65a-520f-4189-a8c6-1b9ebf0c6985 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:07.902039 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-88a6c65a-520f-4189-a8c6-1b9ebf0c6985 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:25:07.903980 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 345/674] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:07.908402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-660588c5-1b16-4554-82dd-2507428929e4 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:07.908782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-660588c5-1b16-4554-82dd-2507428929e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:07.909967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c65a-520f-4189-a8c6-1b9ebf0c6985 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:07.925342 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 330/675] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:07 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:07.928802 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c65a-520f-4189-a8c6-1b9ebf0c6985 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:07.940150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52e464-ff80-45bf-8287-5b005d0f36c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:07.941144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52e464-ff80-45bf-8287-5b005d0f36c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:07.941648 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52e464-ff80-45bf-8287-5b005d0f36c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:07.942196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52e464-ff80-45bf-8287-5b005d0f36c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:07.943154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52e464-ff80-45bf-8287-5b005d0f36c6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:07.943675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52e464-ff80-45bf-8287-5b005d0f36c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:07.945805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52e464-ff80-45bf-8287-5b005d0f36c6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:07.947725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660588c5-1b16-4554-82dd-2507428929e4 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:07.955992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 346/676] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:07.965369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52e464-ff80-45bf-8287-5b005d0f36c6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:07.968014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660588c5-1b16-4554-82dd-2507428929e4 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:07.980505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52e464-ff80-45bf-8287-5b005d0f36c6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:07.982639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802bdc0-927b-4ae8-8476-e9f51c6c5769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:07.983706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802bdc0-927b-4ae8-8476-e9f51c6c5769 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:07.984228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802bdc0-927b-4ae8-8476-e9f51c6c5769 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:07.984759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802bdc0-927b-4ae8-8476-e9f51c6c5769 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:07.985637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802bdc0-927b-4ae8-8476-e9f51c6c5769 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:07.987495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802bdc0-927b-4ae8-8476-e9f51c6c5769 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:07.997668 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff71cb-0e9d-45c7-8aab-7e400bad8233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:07.998501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff71cb-0e9d-45c7-8aab-7e400bad8233 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:07.998809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff71cb-0e9d-45c7-8aab-7e400bad8233 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:07.999092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff71cb-0e9d-45c7-8aab-7e400bad8233 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.001198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-e802bdc0-927b-4ae8-8476-e9f51c6c5769 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:25:08.002965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 331/677] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:07 2021] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:08.013609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802bdc0-927b-4ae8-8476-e9f51c6c5769 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.014503 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff71cb-0e9d-45c7-8aab-7e400bad8233 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.016440 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff71cb-0e9d-45c7-8aab-7e400bad8233 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.026424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802bdc0-927b-4ae8-8476-e9f51c6c5769 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.041837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-c2ff71cb-0e9d-45c7-8aab-7e400bad8233 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:08.043785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 347/678] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:08.045989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef4832-9d38-40f8-a360-ef8c6f409b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.046658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef4832-9d38-40f8-a360-ef8c6f409b63 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.046989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef4832-9d38-40f8-a360-ef8c6f409b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.047269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef4832-9d38-40f8-a360-ef8c6f409b63 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.047992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef4832-9d38-40f8-a360-ef8c6f409b63 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:08.048364 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef4832-9d38-40f8-a360-ef8c6f409b63 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.050063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef4832-9d38-40f8-a360-ef8c6f409b63 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.051285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff71cb-0e9d-45c7-8aab-7e400bad8233 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.061409 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 332/679] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:08.065095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff71cb-0e9d-45c7-8aab-7e400bad8233 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.070753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff698cd-1c63-4225-bd98-c5137c888c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.071411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff698cd-1c63-4225-bd98-c5137c888c63 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.071686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff698cd-1c63-4225-bd98-c5137c888c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.071957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff698cd-1c63-4225-bd98-c5137c888c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.072770 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff698cd-1c63-4225-bd98-c5137c888c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:08.073074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff698cd-1c63-4225-bd98-c5137c888c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.073345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef4832-9d38-40f8-a360-ef8c6f409b63 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.074667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff698cd-1c63-4225-bd98-c5137c888c63 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.091316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef4832-9d38-40f8-a360-ef8c6f409b63 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.093005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 348/680] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:08.099160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff698cd-1c63-4225-bd98-c5137c888c63 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.110862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff698cd-1c63-4225-bd98-c5137c888c63 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.113676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cebbd-ae3b-4522-8507-9496d2e97e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.114334 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cebbd-ae3b-4522-8507-9496d2e97e00 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.114617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cebbd-ae3b-4522-8507-9496d2e97e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.114891 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cebbd-ae3b-4522-8507-9496d2e97e00 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.115597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cebbd-ae3b-4522-8507-9496d2e97e00 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:08.115901 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cebbd-ae3b-4522-8507-9496d2e97e00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.117328 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554684f8-5a64-4c0a-bb3e-2da0e61f2d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.117557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cebbd-ae3b-4522-8507-9496d2e97e00 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.118621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554684f8-5a64-4c0a-bb3e-2da0e61f2d56 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.119307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554684f8-5a64-4c0a-bb3e-2da0e61f2d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.119783 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554684f8-5a64-4c0a-bb3e-2da0e61f2d56 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.128254 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554684f8-5a64-4c0a-bb3e-2da0e61f2d56 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.130677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554684f8-5a64-4c0a-bb3e-2da0e61f2d56 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.134814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 333/681] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/services?type=network => generated 350 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:08.143765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cebbd-ae3b-4522-8507-9496d2e97e00 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.156192 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-554684f8-5a64-4c0a-bb3e-2da0e61f2d56 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:25:08.157720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 349/682] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:08.165156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554684f8-5a64-4c0a-bb3e-2da0e61f2d56 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.170735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cebbd-ae3b-4522-8507-9496d2e97e00 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.176643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554684f8-5a64-4c0a-bb3e-2da0e61f2d56 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.181999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b1c44-a42e-48d1-aa80-7808c685ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.182993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b1c44-a42e-48d1-aa80-7808c685ac14 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.183505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b1c44-a42e-48d1-aa80-7808c685ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.184035 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b1c44-a42e-48d1-aa80-7808c685ac14 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.185154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b1c44-a42e-48d1-aa80-7808c685ac14 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:08.185738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b1c44-a42e-48d1-aa80-7808c685ac14 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.187904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b1c44-a42e-48d1-aa80-7808c685ac14 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.189078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802172a9-cef3-495e-995f-8b2290a9d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.189745 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802172a9-cef3-495e-995f-8b2290a9d946 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.190027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802172a9-cef3-495e-995f-8b2290a9d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.190302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802172a9-cef3-495e-995f-8b2290a9d946 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.191212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802172a9-cef3-495e-995f-8b2290a9d946 admin admin] RBAC: Adding query filter params (interface=public, service_id=e7909976dfaf4aa3951a9d6c26c1b081, region_id=RegionOne) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:08.191524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802172a9-cef3-495e-995f-8b2290a9d946 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.195240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-802172a9-cef3-495e-995f-8b2290a9d946 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:08.195240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:25:08.195240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:25:08.195240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802172a9-cef3-495e-995f-8b2290a9d946 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.206629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 334/683] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/endpoints?service_id=e7909976dfaf4aa3951a9d6c26c1b081&interface=public®ion_id=RegionOne => generated 194 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:08.216393 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 350/684] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:08.221386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802172a9-cef3-495e-995f-8b2290a9d946 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.222352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b1c44-a42e-48d1-aa80-7808c685ac14 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.234782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b1c44-a42e-48d1-aa80-7808c685ac14 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.239843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c38803-a923-4e46-8926-e5f6604d8948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.240946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c38803-a923-4e46-8926-e5f6604d8948 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.241484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c38803-a923-4e46-8926-e5f6604d8948 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.242040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c38803-a923-4e46-8926-e5f6604d8948 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.242789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802172a9-cef3-495e-995f-8b2290a9d946 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.251237 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c38803-a923-4e46-8926-e5f6604d8948 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.253516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c38803-a923-4e46-8926-e5f6604d8948 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.261126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d08f9-3491-4a8b-88c4-a9e12f49fb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.261791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d08f9-3491-4a8b-88c4-a9e12f49fb20 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.262074 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d08f9-3491-4a8b-88c4-a9e12f49fb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.262345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d08f9-3491-4a8b-88c4-a9e12f49fb20 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.263027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d08f9-3491-4a8b-88c4-a9e12f49fb20 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.264650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d08f9-3491-4a8b-88c4-a9e12f49fb20 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.265281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 351/685] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:25:08.271922 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c38803-a923-4e46-8926-e5f6604d8948 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.279147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 335/686] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/services => generated 772 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:08.282341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c38803-a923-4e46-8926-e5f6604d8948 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.287436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf56df0-7f31-45ff-b87f-93e88685a93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.289260 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf56df0-7f31-45ff-b87f-93e88685a93a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.289764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf56df0-7f31-45ff-b87f-93e88685a93a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.290276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf56df0-7f31-45ff-b87f-93e88685a93a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.302260 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf56df0-7f31-45ff-b87f-93e88685a93a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.304684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf56df0-7f31-45ff-b87f-93e88685a93a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.323564 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-7bf56df0-7f31-45ff-b87f-93e88685a93a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:08.325597 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 352/687] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:08.331908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d08f9-3491-4a8b-88c4-a9e12f49fb20 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.343088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d08f9-3491-4a8b-88c4-a9e12f49fb20 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.348387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5789ab-2aec-48dc-b12f-2207e04c647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.349474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5789ab-2aec-48dc-b12f-2207e04c647f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.350059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5789ab-2aec-48dc-b12f-2207e04c647f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.350540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5789ab-2aec-48dc-b12f-2207e04c647f admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.351599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5789ab-2aec-48dc-b12f-2207e04c647f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:08.352115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5789ab-2aec-48dc-b12f-2207e04c647f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.354173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5789ab-2aec-48dc-b12f-2207e04c647f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.367489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 336/688] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:08.374165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf56df0-7f31-45ff-b87f-93e88685a93a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.385607 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf56df0-7f31-45ff-b87f-93e88685a93a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.390902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86714f5c-f5d8-4aab-adbc-0359dcd7122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.392132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86714f5c-f5d8-4aab-adbc-0359dcd7122a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.392736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86714f5c-f5d8-4aab-adbc-0359dcd7122a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.393252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86714f5c-f5d8-4aab-adbc-0359dcd7122a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.402676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86714f5c-f5d8-4aab-adbc-0359dcd7122a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.405227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86714f5c-f5d8-4aab-adbc-0359dcd7122a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.428284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-86714f5c-f5d8-4aab-adbc-0359dcd7122a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:08.429951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 353/689] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:08.436528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5789ab-2aec-48dc-b12f-2207e04c647f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.452384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5789ab-2aec-48dc-b12f-2207e04c647f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.457761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d63e3-20c5-4fd4-adc6-8796bed70642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.464549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d63e3-20c5-4fd4-adc6-8796bed70642 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.465394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d63e3-20c5-4fd4-adc6-8796bed70642 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.465931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d63e3-20c5-4fd4-adc6-8796bed70642 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.466998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d63e3-20c5-4fd4-adc6-8796bed70642 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:08.467550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d63e3-20c5-4fd4-adc6-8796bed70642 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.469768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d63e3-20c5-4fd4-adc6-8796bed70642 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.485198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 337/690] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:08.492938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86714f5c-f5d8-4aab-adbc-0359dcd7122a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:08.504232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86714f5c-f5d8-4aab-adbc-0359dcd7122a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:08.509402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db49fd0-2bed-465b-864c-a166bc695508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:08.510311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db49fd0-2bed-465b-864c-a166bc695508 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.510797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db49fd0-2bed-465b-864c-a166bc695508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.511292 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db49fd0-2bed-465b-864c-a166bc695508 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.512401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db49fd0-2bed-465b-864c-a166bc695508 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=6812bbce1050419ea721a9b648b87bef) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:08.512970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db49fd0-2bed-465b-864c-a166bc695508 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:08.515063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db49fd0-2bed-465b-864c-a166bc695508 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:08.522105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 354/691] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:08 2021] GET /identity/v3/role_assignments?user.id=6812bbce1050419ea721a9b648b87bef&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:08.983062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f604-7454-4938-9e18-f1f60044bb0c None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.983915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f604-7454-4938-9e18-f1f60044bb0c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.984204 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f604-7454-4938-9e18-f1f60044bb0c None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:08.986212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 338/692] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:08.992830 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bbf80-366b-4cd6-bdd3-df049b966a35 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:08.993763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bbf80-366b-4cd6-bdd3-df049b966a35 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:08.994262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bbf80-366b-4cd6-bdd3-df049b966a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.013625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a95bbf80-366b-4cd6-bdd3-df049b966a35 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:09.015251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a95bbf80-366b-4cd6-bdd3-df049b966a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:09.029306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 355/693] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:09.052227 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f604-7454-4938-9e18-f1f60044bb0c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.066097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f604-7454-4938-9e18-f1f60044bb0c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.071851 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fe09a-b3c5-4a3b-8e6b-36334b7daaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.073423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fe09a-b3c5-4a3b-8e6b-36334b7daaed admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.074419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fe09a-b3c5-4a3b-8e6b-36334b7daaed admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.074982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fe09a-b3c5-4a3b-8e6b-36334b7daaed admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.088785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fe09a-b3c5-4a3b-8e6b-36334b7daaed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:09.096068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-648fe09a-b3c5-4a3b-8e6b-36334b7daaed admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:25:09.103242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 339/694] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:09.104859 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bbf80-366b-4cd6-bdd3-df049b966a35 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.114530 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bbf80-366b-4cd6-bdd3-df049b966a35 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.116250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb701-8af3-4da9-b002-3c00a4bf5b5b None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.117264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb701-8af3-4da9-b002-3c00a4bf5b5b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.117666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb701-8af3-4da9-b002-3c00a4bf5b5b None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.119861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 340/695] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:09.125582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014a56c-a8c1-4b2f-901c-609f0146f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.126427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014a56c-a8c1-4b2f-901c-609f0146f67f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.126834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014a56c-a8c1-4b2f-901c-609f0146f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.127226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014a56c-a8c1-4b2f-901c-609f0146f67f admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.128132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014a56c-a8c1-4b2f-901c-609f0146f67f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.129092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014a56c-a8c1-4b2f-901c-609f0146f67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.130079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014a56c-a8c1-4b2f-901c-609f0146f67f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.134360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052b6a-a83d-4809-954d-ceaa88777549 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.134889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052b6a-a83d-4809-954d-ceaa88777549 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.135392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052b6a-a83d-4809-954d-ceaa88777549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.146742 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 356/696] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:09.157376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014a56c-a8c1-4b2f-901c-609f0146f67f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.158805 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-71052b6a-a83d-4809-954d-ceaa88777549 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:09.159999 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-71052b6a-a83d-4809-954d-ceaa88777549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:09.173435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014a56c-a8c1-4b2f-901c-609f0146f67f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.175247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 341/697] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:09.179413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4ff01-597b-4041-aaaf-13e9ac0c65cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.180259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4ff01-597b-4041-aaaf-13e9ac0c65cc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.180575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4ff01-597b-4041-aaaf-13e9ac0c65cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.180953 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4ff01-597b-4041-aaaf-13e9ac0c65cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.192530 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4ff01-597b-4041-aaaf-13e9ac0c65cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.194454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4ff01-597b-4041-aaaf-13e9ac0c65cc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.210962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71052b6a-a83d-4809-954d-ceaa88777549 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.222925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71052b6a-a83d-4809-954d-ceaa88777549 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.230579 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df55997-5ee9-442b-8e6d-7effbe59af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.232725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-9cd4ff01-597b-4041-aaaf-13e9ac0c65cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:09.234178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55997-5ee9-442b-8e6d-7effbe59af50 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.234426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55997-5ee9-442b-8e6d-7effbe59af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.234758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55997-5ee9-442b-8e6d-7effbe59af50 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.237159 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 357/698] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:09.241194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4ff01-597b-4041-aaaf-13e9ac0c65cc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.257042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df55997-5ee9-442b-8e6d-7effbe59af50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:09.257745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4ff01-597b-4041-aaaf-13e9ac0c65cc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.262365 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bf433-dff0-4c4a-893d-657e88aba115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.263084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bf433-dff0-4c4a-893d-657e88aba115 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.263368 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bf433-dff0-4c4a-893d-657e88aba115 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.263642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bf433-dff0-4c4a-893d-657e88aba115 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.264455 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bf433-dff0-4c4a-893d-657e88aba115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.268403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bf433-dff0-4c4a-893d-657e88aba115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.268403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bf433-dff0-4c4a-893d-657e88aba115 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.271300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-4df55997-5ee9-442b-8e6d-7effbe59af50 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:25:09.279183 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 342/699] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:09.280840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df55997-5ee9-442b-8e6d-7effbe59af50 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.292224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 358/700] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:09.296263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df55997-5ee9-442b-8e6d-7effbe59af50 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.299989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bf433-dff0-4c4a-893d-657e88aba115 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.309774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6492-9951-4d23-b7f8-4623e465d92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.312222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6492-9951-4d23-b7f8-4623e465d92d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.312676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6492-9951-4d23-b7f8-4623e465d92d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.313118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6492-9951-4d23-b7f8-4623e465d92d admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.314057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c6492-9951-4d23-b7f8-4623e465d92d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.315277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c6492-9951-4d23-b7f8-4623e465d92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.315437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bf433-dff0-4c4a-893d-657e88aba115 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.320221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c6492-9951-4d23-b7f8-4623e465d92d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.325835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d1b2-93c6-4b78-a174-63691c6e659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.326843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d1b2-93c6-4b78-a174-63691c6e659e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.327954 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d1b2-93c6-4b78-a174-63691c6e659e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.328799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d1b2-93c6-4b78-a174-63691c6e659e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.342672 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 343/701] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:09.344123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24d1b2-93c6-4b78-a174-63691c6e659e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.346497 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24d1b2-93c6-4b78-a174-63691c6e659e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.349401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6492-9951-4d23-b7f8-4623e465d92d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.364150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6492-9951-4d23-b7f8-4623e465d92d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.373994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-5b24d1b2-93c6-4b78-a174-63691c6e659e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:25:09.375772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 359/702] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:09.380195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fcd72-8258-48b8-83bc-819ddf3997cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.381877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d1b2-93c6-4b78-a174-63691c6e659e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.384915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fcd72-8258-48b8-83bc-819ddf3997cc admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.385210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fcd72-8258-48b8-83bc-819ddf3997cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.385494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fcd72-8258-48b8-83bc-819ddf3997cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.401476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d1b2-93c6-4b78-a174-63691c6e659e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.407586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdc6ef-8982-44b3-ab55-e03eaf53fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.408021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fcd72-8258-48b8-83bc-819ddf3997cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.408686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdc6ef-8982-44b3-ab55-e03eaf53fb4f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.409191 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdc6ef-8982-44b3-ab55-e03eaf53fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.409615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdc6ef-8982-44b3-ab55-e03eaf53fb4f admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.410370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fcd72-8258-48b8-83bc-819ddf3997cc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.410812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdc6ef-8982-44b3-ab55-e03eaf53fb4f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.411306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdc6ef-8982-44b3-ab55-e03eaf53fb4f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.413428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdc6ef-8982-44b3-ab55-e03eaf53fb4f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.437558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-e91fcd72-8258-48b8-83bc-819ddf3997cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:09.439366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 344/703] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:09.439880 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 360/704] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:09.446486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fcd72-8258-48b8-83bc-819ddf3997cc admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.446644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdc6ef-8982-44b3-ab55-e03eaf53fb4f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.457041 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fcd72-8258-48b8-83bc-819ddf3997cc admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.462014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9e368-7d08-4427-b864-b2b43476efa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.463049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9e368-7d08-4427-b864-b2b43476efa2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.463512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9e368-7d08-4427-b864-b2b43476efa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.464023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9e368-7d08-4427-b864-b2b43476efa2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.464140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdc6ef-8982-44b3-ab55-e03eaf53fb4f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.473494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91861bb1-bb3b-4f5a-ab18-9d1eb63566fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.475193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91861bb1-bb3b-4f5a-ab18-9d1eb63566fd admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.476077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91861bb1-bb3b-4f5a-ab18-9d1eb63566fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.476993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91861bb1-bb3b-4f5a-ab18-9d1eb63566fd admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.479481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91861bb1-bb3b-4f5a-ab18-9d1eb63566fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.479986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91861bb1-bb3b-4f5a-ab18-9d1eb63566fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.483700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91861bb1-bb3b-4f5a-ab18-9d1eb63566fd admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.487067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9e368-7d08-4427-b864-b2b43476efa2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.489471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9e368-7d08-4427-b864-b2b43476efa2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.510131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 361/705] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:09.516270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91861bb1-bb3b-4f5a-ab18-9d1eb63566fd admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.518833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-77a9e368-7d08-4427-b864-b2b43476efa2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:09.520622 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 345/706] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:09.528433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91861bb1-bb3b-4f5a-ab18-9d1eb63566fd admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.529698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9e368-7d08-4427-b864-b2b43476efa2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.541171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79263-2565-4e31-84eb-e4e642d41661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.542350 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79263-2565-4e31-84eb-e4e642d41661 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.543105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79263-2565-4e31-84eb-e4e642d41661 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.543563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79263-2565-4e31-84eb-e4e642d41661 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.555263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9e368-7d08-4427-b864-b2b43476efa2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.559866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79263-2565-4e31-84eb-e4e642d41661 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.563629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79263-2565-4e31-84eb-e4e642d41661 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.566253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e197f0e-5081-4f1a-a436-033b258b6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.567128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e197f0e-5081-4f1a-a436-033b258b6f2e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.569013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e197f0e-5081-4f1a-a436-033b258b6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.569413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e197f0e-5081-4f1a-a436-033b258b6f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.571418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e197f0e-5081-4f1a-a436-033b258b6f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.571836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e197f0e-5081-4f1a-a436-033b258b6f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.573609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e197f0e-5081-4f1a-a436-033b258b6f2e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.582845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-61b79263-2565-4e31-84eb-e4e642d41661 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:25:09.584698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 362/707] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/users/swift => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:09.591175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79263-2565-4e31-84eb-e4e642d41661 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.594925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 346/708] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:09.601123 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e197f0e-5081-4f1a-a436-033b258b6f2e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.602110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79263-2565-4e31-84eb-e4e642d41661 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.607313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b44031-2a4f-4ba1-a551-33f9ce682172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.608189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b44031-2a4f-4ba1-a551-33f9ce682172 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.608642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b44031-2a4f-4ba1-a551-33f9ce682172 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.609131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b44031-2a4f-4ba1-a551-33f9ce682172 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.610127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b44031-2a4f-4ba1-a551-33f9ce682172 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.610579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b44031-2a4f-4ba1-a551-33f9ce682172 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.612171 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e197f0e-5081-4f1a-a436-033b258b6f2e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.613227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b44031-2a4f-4ba1-a551-33f9ce682172 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.618423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abfde5-b073-4574-beae-a8f699242e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.619315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abfde5-b073-4574-beae-a8f699242e4d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.619708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abfde5-b073-4574-beae-a8f699242e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.620099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abfde5-b073-4574-beae-a8f699242e4d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.628711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abfde5-b073-4574-beae-a8f699242e4d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.631664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abfde5-b073-4574-beae-a8f699242e4d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.634445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 363/709] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:09.640403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbba33c-4d4b-4a40-8d23-271c91e40a79 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.640739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbba33c-4d4b-4a40-8d23-271c91e40a79 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.641024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbba33c-4d4b-4a40-8d23-271c91e40a79 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.643015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 364/710] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:09 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:09.644622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbba33c-4d4b-4a40-8d23-271c91e40a79 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.647048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-67abfde5-b073-4574-beae-a8f699242e4d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:09.648864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 347/711] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:09.650136 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d39f6-5a80-4042-8d34-648441702fc5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.650517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d39f6-5a80-4042-8d34-648441702fc5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.650920 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d39f6-5a80-4042-8d34-648441702fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.658054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbba33c-4d4b-4a40-8d23-271c91e40a79 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.663074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50a07c-f145-4932-ab60-ed91550f213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.663887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a07c-f145-4932-ab60-ed91550f213a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.664164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a07c-f145-4932-ab60-ed91550f213a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.664467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a07c-f145-4932-ab60-ed91550f213a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.674604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-788d39f6-5a80-4042-8d34-648441702fc5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:09.676042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-788d39f6-5a80-4042-8d34-648441702fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:09.680689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50a07c-f145-4932-ab60-ed91550f213a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.682621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50a07c-f145-4932-ab60-ed91550f213a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.686069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 348/712] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:09.687062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d39f6-5a80-4042-8d34-648441702fc5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.698859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d39f6-5a80-4042-8d34-648441702fc5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.703770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30157-dab9-42ce-bf0d-b4102ed6d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.704602 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30157-dab9-42ce-bf0d-b4102ed6d015 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.705038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30157-dab9-42ce-bf0d-b4102ed6d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.705442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30157-dab9-42ce-bf0d-b4102ed6d015 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.705646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-9c50a07c-f145-4932-ab60-ed91550f213a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:09.706483 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c30157-dab9-42ce-bf0d-b4102ed6d015 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.706892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c30157-dab9-42ce-bf0d-b4102ed6d015 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.707129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 365/713] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:09.709109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c30157-dab9-42ce-bf0d-b4102ed6d015 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.713447 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50a07c-f145-4932-ab60-ed91550f213a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.722959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50a07c-f145-4932-ab60-ed91550f213a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.724259 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 349/714] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:09.727712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ff960-9ece-4ea2-973f-6634f25473be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.728387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ff960-9ece-4ea2-973f-6634f25473be admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.728739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ff960-9ece-4ea2-973f-6634f25473be admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.729012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ff960-9ece-4ea2-973f-6634f25473be admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.729731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ff960-9ece-4ea2-973f-6634f25473be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.730029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ff960-9ece-4ea2-973f-6634f25473be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.731627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ff960-9ece-4ea2-973f-6634f25473be admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.732196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30157-dab9-42ce-bf0d-b4102ed6d015 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.745686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 366/715] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:09.746466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ff960-9ece-4ea2-973f-6634f25473be admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.746857 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30157-dab9-42ce-bf0d-b4102ed6d015 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.752006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749c8b1-01b5-4678-880e-ea66de23e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.753175 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749c8b1-01b5-4678-880e-ea66de23e7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.753561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749c8b1-01b5-4678-880e-ea66de23e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.754026 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749c8b1-01b5-4678-880e-ea66de23e7cc admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/36d3a6eb24b04e14a42d771c9c768ed2/roles/0bf399b6291e451e9c1560112432ef33` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.762119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ff960-9ece-4ea2-973f-6634f25473be admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.766807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28a55c-1181-49b2-8e13-b33e203b2598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.767611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28a55c-1181-49b2-8e13-b33e203b2598 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.767890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28a55c-1181-49b2-8e13-b33e203b2598 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.768160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28a55c-1181-49b2-8e13-b33e203b2598 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.768850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28a55c-1181-49b2-8e13-b33e203b2598 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.770434 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28a55c-1181-49b2-8e13-b33e203b2598 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.773445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749c8b1-01b5-4678-880e-ea66de23e7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=36d3a6eb24b04e14a42d771c9c768ed2, role_id=0bf399b6291e451e9c1560112432ef33)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.776475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749c8b1-01b5-4678-880e-ea66de23e7cc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.782236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-1a28a55c-1181-49b2-8e13-b33e203b2598 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:25:09.783473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 367/716] 10.222.0.25 () {56 vars in 1151 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:09.784234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28a55c-1181-49b2-8e13-b33e203b2598 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.798447 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28a55c-1181-49b2-8e13-b33e203b2598 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.804729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47c79e-0fcd-40ff-adf3-5592fc51f780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.805960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47c79e-0fcd-40ff-adf3-5592fc51f780 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.805960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47c79e-0fcd-40ff-adf3-5592fc51f780 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.806123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47c79e-0fcd-40ff-adf3-5592fc51f780 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.814781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47c79e-0fcd-40ff-adf3-5592fc51f780 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.816805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47c79e-0fcd-40ff-adf3-5592fc51f780 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.830082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-6f47c79e-0fcd-40ff-adf3-5592fc51f780 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:09.831532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 368/717] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:09.833652 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47c79e-0fcd-40ff-adf3-5592fc51f780 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.843778 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47c79e-0fcd-40ff-adf3-5592fc51f780 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.856660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 350/718] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:25:09 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/36d3a6eb24b04e14a42d771c9c768ed2/roles/0bf399b6291e451e9c1560112432ef33 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:25:09.858295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749c8b1-01b5-4678-880e-ea66de23e7cc admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.908017 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf11cb1-4910-4a09-a6c4-61f4b58940e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.908828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf11cb1-4910-4a09-a6c4-61f4b58940e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.909115 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf11cb1-4910-4a09-a6c4-61f4b58940e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.909388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf11cb1-4910-4a09-a6c4-61f4b58940e9 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.910200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf11cb1-4910-4a09-a6c4-61f4b58940e9 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.910519 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf11cb1-4910-4a09-a6c4-61f4b58940e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.912549 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf11cb1-4910-4a09-a6c4-61f4b58940e9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.918944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 369/719] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:09.925325 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf11cb1-4910-4a09-a6c4-61f4b58940e9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.935973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf11cb1-4910-4a09-a6c4-61f4b58940e9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.941428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80767c73-f2c2-4e31-9828-7b117fb2e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.942161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80767c73-f2c2-4e31-9828-7b117fb2e479 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.942436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80767c73-f2c2-4e31-9828-7b117fb2e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.942712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80767c73-f2c2-4e31-9828-7b117fb2e479 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.943531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80767c73-f2c2-4e31-9828-7b117fb2e479 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.943886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80767c73-f2c2-4e31-9828-7b117fb2e479 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.944555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749c8b1-01b5-4678-880e-ea66de23e7cc admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.946155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80767c73-f2c2-4e31-9828-7b117fb2e479 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.951429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c97c14-5769-4556-9ca5-e21708b172f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.952531 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c97c14-5769-4556-9ca5-e21708b172f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.953045 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c97c14-5769-4556-9ca5-e21708b172f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.953153 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 370/720] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:09.953640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c97c14-5769-4556-9ca5-e21708b172f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.954671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c97c14-5769-4556-9ca5-e21708b172f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:09.955199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c97c14-5769-4556-9ca5-e21708b172f3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.957406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c97c14-5769-4556-9ca5-e21708b172f3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:09.959727 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80767c73-f2c2-4e31-9828-7b117fb2e479 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.971692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80767c73-f2c2-4e31-9828-7b117fb2e479 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:09.974015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 351/721] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:09.982307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c97c14-5769-4556-9ca5-e21708b172f3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:09.983342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11bfd0-21de-4f71-9b32-3e9442791742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:09.984022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11bfd0-21de-4f71-9b32-3e9442791742 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:09.984302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11bfd0-21de-4f71-9b32-3e9442791742 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:09.984628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11bfd0-21de-4f71-9b32-3e9442791742 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:09.985475 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11bfd0-21de-4f71-9b32-3e9442791742 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:09.986720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-ed11bfd0-21de-4f71-9b32-3e9442791742 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:09.986720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:25:09.986720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:25:09.987621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11bfd0-21de-4f71-9b32-3e9442791742 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:10.003328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c97c14-5769-4556-9ca5-e21708b172f3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:10.014954 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4071e54-1a40-42d3-9c5b-2217008faa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:10.015918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4071e54-1a40-42d3-9c5b-2217008faa5f admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:10.016198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4071e54-1a40-42d3-9c5b-2217008faa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:10.016558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4071e54-1a40-42d3-9c5b-2217008faa5f admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/c23aad5d62b84cd7a4da788500148f7e/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:10.018653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4071e54-1a40-42d3-9c5b-2217008faa5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=c23aad5d62b84cd7a4da788500148f7e, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:10.021450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4071e54-1a40-42d3-9c5b-2217008faa5f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:10.082233 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 371/722] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 04:25:09 2021] POST /identity/v3/endpoints => generated 346 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:25:10.127866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 352/723] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:25:09 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/c23aad5d62b84cd7a4da788500148f7e/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:25:11.017144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb0e05-3dd6-4a2d-bb3b-d87ed581f41e None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.017488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb0e05-3dd6-4a2d-bb3b-d87ed581f41e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.017663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb0e05-3dd6-4a2d-bb3b-d87ed581f41e None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.019710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 372/724] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:11.026818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c649e-e461-44c2-90a4-8bef212f0a97 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.027272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c649e-e461-44c2-90a4-8bef212f0a97 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.027452 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c649e-e461-44c2-90a4-8bef212f0a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.052494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d70c649e-e461-44c2-90a4-8bef212f0a97 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:11.053746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d70c649e-e461-44c2-90a4-8bef212f0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:11.146285 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 353/725] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:11 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:11.189404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb0e05-3dd6-4a2d-bb3b-d87ed581f41e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:11.210032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb0e05-3dd6-4a2d-bb3b-d87ed581f41e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:11.218363 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991574-831c-4015-9389-990519ce450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:11.219166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991574-831c-4015-9389-990519ce450c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.219443 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991574-831c-4015-9389-990519ce450c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.219713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991574-831c-4015-9389-990519ce450c admin admin] PATH_INFO: `/v3/services/network` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.220388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16991574-831c-4015-9389-990519ce450c admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:11.221984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16991574-831c-4015-9389-990519ce450c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:11.239744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-16991574-831c-4015-9389-990519ce450c admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:25:11.241286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 373/726] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:11 2021] GET /identity/v3/services/network => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:11.247786 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c649e-e461-44c2-90a4-8bef212f0a97 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:11.257661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c649e-e461-44c2-90a4-8bef212f0a97 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:11.268757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c14f-b63d-4d6f-b9b8-02054b4c4700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:11.269711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c14f-b63d-4d6f-b9b8-02054b4c4700 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.270195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c14f-b63d-4d6f-b9b8-02054b4c4700 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.270668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c14f-b63d-4d6f-b9b8-02054b4c4700 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.271614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c14f-b63d-4d6f-b9b8-02054b4c4700 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:11.272126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c14f-b63d-4d6f-b9b8-02054b4c4700 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:11.274512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c14f-b63d-4d6f-b9b8-02054b4c4700 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:11.284382 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 354/727] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:11 2021] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:11.286300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991574-831c-4015-9389-990519ce450c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:11.297544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991574-831c-4015-9389-990519ce450c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:11.308970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a5320-349f-4d2d-968c-31788b8ceba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:11.309650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5320-349f-4d2d-968c-31788b8ceba1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.309935 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5320-349f-4d2d-968c-31788b8ceba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.310233 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5320-349f-4d2d-968c-31788b8ceba1 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.311012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a5320-349f-4d2d-968c-31788b8ceba1 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:11.311315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a5320-349f-4d2d-968c-31788b8ceba1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:11.312954 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a5320-349f-4d2d-968c-31788b8ceba1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:11.318601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 374/728] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:11 2021] GET /identity/v3/services?type=network => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:11.325656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c14f-b63d-4d6f-b9b8-02054b4c4700 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:11.337036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c14f-b63d-4d6f-b9b8-02054b4c4700 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:11.349958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e7189-2844-44a8-b5f4-0cbc1e688f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:11.350628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7189-2844-44a8-b5f4-0cbc1e688f6d admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.350945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7189-2844-44a8-b5f4-0cbc1e688f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.351222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7189-2844-44a8-b5f4-0cbc1e688f6d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.351985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e7189-2844-44a8-b5f4-0cbc1e688f6d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:11.353209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-c60e7189-2844-44a8-b5f4-0cbc1e688f6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:11.353209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:25:11.353209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:25:11.354102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e7189-2844-44a8-b5f4-0cbc1e688f6d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:11.546131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 355/729] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 04:25:11 2021] POST /identity/v3/endpoints => generated 327 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:11.563619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80bde-2598-46ba-98b5-e4355e6dde55 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.564302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80bde-2598-46ba-98b5-e4355e6dde55 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.564824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80bde-2598-46ba-98b5-e4355e6dde55 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.567442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 375/730] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:11.575494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e588b8-84ea-49be-9f5f-3854921e0aad None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.576167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e588b8-84ea-49be-9f5f-3854921e0aad None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.576732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e588b8-84ea-49be-9f5f-3854921e0aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.602335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e6e588b8-84ea-49be-9f5f-3854921e0aad None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:11.605044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e6e588b8-84ea-49be-9f5f-3854921e0aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:11.634167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 356/731] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:11 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:11.686261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee80bde-2598-46ba-98b5-e4355e6dde55 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:11.713464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee80bde-2598-46ba-98b5-e4355e6dde55 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:11.719066 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793736-f052-4bd7-96be-206ba92921ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:11.719884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793736-f052-4bd7-96be-206ba92921ba admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.720165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793736-f052-4bd7-96be-206ba92921ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.720469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793736-f052-4bd7-96be-206ba92921ba admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.721127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793736-f052-4bd7-96be-206ba92921ba admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:11.722747 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793736-f052-4bd7-96be-206ba92921ba admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:11.736334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-a4793736-f052-4bd7-96be-206ba92921ba admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:25:11.737962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 376/732] 10.222.0.25 () {56 vars in 1154 bytes} [Fri Aug 27 04:25:11 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:11.745121 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e588b8-84ea-49be-9f5f-3854921e0aad None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:11.754877 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e588b8-84ea-49be-9f5f-3854921e0aad None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:11.765595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51862545-9f50-4e48-b85e-8abb228da6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:11.766359 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51862545-9f50-4e48-b85e-8abb228da6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.766649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51862545-9f50-4e48-b85e-8abb228da6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.766925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51862545-9f50-4e48-b85e-8abb228da6d7 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.767658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51862545-9f50-4e48-b85e-8abb228da6d7 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:11.767966 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51862545-9f50-4e48-b85e-8abb228da6d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:11.769878 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51862545-9f50-4e48-b85e-8abb228da6d7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:11.781379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 357/733] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:11 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:11.787452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793736-f052-4bd7-96be-206ba92921ba admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:11.802093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793736-f052-4bd7-96be-206ba92921ba admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:11.811225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6cf82-df24-4e2f-b5f7-1a27850c04be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:11.812318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6cf82-df24-4e2f-b5f7-1a27850c04be admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:11.812838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6cf82-df24-4e2f-b5f7-1a27850c04be admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:11.813315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6cf82-df24-4e2f-b5f7-1a27850c04be admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:11.814254 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6cf82-df24-4e2f-b5f7-1a27850c04be admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:11.814758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6cf82-df24-4e2f-b5f7-1a27850c04be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:11.816685 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6cf82-df24-4e2f-b5f7-1a27850c04be admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:11.828453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 377/734] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:11 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:12.441510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34ffa0-428b-4e76-98a3-4ce9b7063fb5 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.442558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34ffa0-428b-4e76-98a3-4ce9b7063fb5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.443059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34ffa0-428b-4e76-98a3-4ce9b7063fb5 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.445347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 358/735] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:12.451441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece119c-bcda-4214-bd22-923973c3dca4 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.452287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece119c-bcda-4214-bd22-923973c3dca4 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.452810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece119c-bcda-4214-bd22-923973c3dca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.473670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-fece119c-bcda-4214-bd22-923973c3dca4 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:12.474886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-fece119c-bcda-4214-bd22-923973c3dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:12.483604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 378/736] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:12 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:12.508084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34ffa0-428b-4e76-98a3-4ce9b7063fb5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.520826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34ffa0-428b-4e76-98a3-4ce9b7063fb5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.526129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37bccb-4b9a-4ccd-ba17-5092f7f28af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.527165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bccb-4b9a-4ccd-ba17-5092f7f28af1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.527661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bccb-4b9a-4ccd-ba17-5092f7f28af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.528133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bccb-4b9a-4ccd-ba17-5092f7f28af1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.540086 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37bccb-4b9a-4ccd-ba17-5092f7f28af1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:12.547716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-8d37bccb-4b9a-4ccd-ba17-5092f7f28af1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:25:12.560072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 359/737] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:12.560231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece119c-bcda-4214-bd22-923973c3dca4 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.566622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece119c-bcda-4214-bd22-923973c3dca4 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.571898 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e968a-8f27-42cd-801c-782ab092a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.572986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e968a-8f27-42cd-801c-782ab092a479 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.573466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e968a-8f27-42cd-801c-782ab092a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.573928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e968a-8f27-42cd-801c-782ab092a479 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.574902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e968a-8f27-42cd-801c-782ab092a479 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:12.575395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e968a-8f27-42cd-801c-782ab092a479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.577326 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e968a-8f27-42cd-801c-782ab092a479 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.587987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 379/738] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:12.594673 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37bccb-4b9a-4ccd-ba17-5092f7f28af1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.606357 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37bccb-4b9a-4ccd-ba17-5092f7f28af1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.611406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d162fc-fb66-4490-8bf2-13473acdf546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.612613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d162fc-fb66-4490-8bf2-13473acdf546 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.613070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d162fc-fb66-4490-8bf2-13473acdf546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.613529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d162fc-fb66-4490-8bf2-13473acdf546 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.625675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d162fc-fb66-4490-8bf2-13473acdf546 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.628048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d162fc-fb66-4490-8bf2-13473acdf546 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.645095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e434cca-37c8-4533-abd3-1114b62fe844 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.645439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e434cca-37c8-4533-abd3-1114b62fe844 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.645657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e434cca-37c8-4533-abd3-1114b62fe844 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.647540 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 380/739] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:12.648280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-48d162fc-fb66-4490-8bf2-13473acdf546 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:12.649755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 360/740] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:12.654027 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31dd99-f39f-4782-b70c-1a338ab17522 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.654310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31dd99-f39f-4782-b70c-1a338ab17522 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.654590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31dd99-f39f-4782-b70c-1a338ab17522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.655948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d162fc-fb66-4490-8bf2-13473acdf546 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.667072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d162fc-fb66-4490-8bf2-13473acdf546 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.672031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd172cc-44fa-42a4-9d95-892c2c00e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.672772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd172cc-44fa-42a4-9d95-892c2c00e89c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.673053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd172cc-44fa-42a4-9d95-892c2c00e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.673323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd172cc-44fa-42a4-9d95-892c2c00e89c admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.674105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd172cc-44fa-42a4-9d95-892c2c00e89c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:12.674411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd172cc-44fa-42a4-9d95-892c2c00e89c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.676019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd172cc-44fa-42a4-9d95-892c2c00e89c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.680975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-fb31dd99-f39f-4782-b70c-1a338ab17522 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:12.682193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-fb31dd99-f39f-4782-b70c-1a338ab17522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:12.689298 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 361/741] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:12.695007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd172cc-44fa-42a4-9d95-892c2c00e89c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.695765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 381/742] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:12 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:12.708432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd172cc-44fa-42a4-9d95-892c2c00e89c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.710061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff174e78-03a2-488c-a5b8-a756f374ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.711425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174e78-03a2-488c-a5b8-a756f374ee66 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.711707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174e78-03a2-488c-a5b8-a756f374ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.712025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174e78-03a2-488c-a5b8-a756f374ee66 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.720475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff174e78-03a2-488c-a5b8-a756f374ee66 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.722512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff174e78-03a2-488c-a5b8-a756f374ee66 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.725602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31dd99-f39f-4782-b70c-1a338ab17522 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.735147 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31dd99-f39f-4782-b70c-1a338ab17522 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.740990 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b6fba-b8d4-4be3-8e2f-d3ab8fd4290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.741560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-ff174e78-03a2-488c-a5b8-a756f374ee66 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:25:12.741836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b6fba-b8d4-4be3-8e2f-d3ab8fd4290d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.742117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b6fba-b8d4-4be3-8e2f-d3ab8fd4290d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.742387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b6fba-b8d4-4be3-8e2f-d3ab8fd4290d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.748601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 362/743] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:12.750167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff174e78-03a2-488c-a5b8-a756f374ee66 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.759132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b6fba-b8d4-4be3-8e2f-d3ab8fd4290d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:12.762607 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff174e78-03a2-488c-a5b8-a756f374ee66 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.766697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-417b6fba-b8d4-4be3-8e2f-d3ab8fd4290d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:25:12.767602 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7543b72-0f14-4974-99ba-62159e605797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.768385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 382/744] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:12.774511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543b72-0f14-4974-99ba-62159e605797 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.774903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543b72-0f14-4974-99ba-62159e605797 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.775129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543b72-0f14-4974-99ba-62159e605797 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.775961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7543b72-0f14-4974-99ba-62159e605797 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:12.776273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7543b72-0f14-4974-99ba-62159e605797 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.776653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b6fba-b8d4-4be3-8e2f-d3ab8fd4290d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.778171 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7543b72-0f14-4974-99ba-62159e605797 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.787068 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b6fba-b8d4-4be3-8e2f-d3ab8fd4290d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.793528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811fe8-ca7a-4865-bfdf-3939e56e8870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.794643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811fe8-ca7a-4865-bfdf-3939e56e8870 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.795149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811fe8-ca7a-4865-bfdf-3939e56e8870 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.795641 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811fe8-ca7a-4865-bfdf-3939e56e8870 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.796692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811fe8-ca7a-4865-bfdf-3939e56e8870 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:12.797269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811fe8-ca7a-4865-bfdf-3939e56e8870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.799196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811fe8-ca7a-4865-bfdf-3939e56e8870 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.804569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 363/745] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:12.807277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7543b72-0f14-4974-99ba-62159e605797 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.821719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 383/746] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:12.822541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7543b72-0f14-4974-99ba-62159e605797 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.824174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811fe8-ca7a-4865-bfdf-3939e56e8870 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.833039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab41c14-1f91-4c92-9bab-be5554c46f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.834150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41c14-1f91-4c92-9bab-be5554c46f0c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.834555 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811fe8-ca7a-4865-bfdf-3939e56e8870 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.834916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41c14-1f91-4c92-9bab-be5554c46f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.836130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41c14-1f91-4c92-9bab-be5554c46f0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.839611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955268f-4e65-4809-83f4-a97f5f76c9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.840421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955268f-4e65-4809-83f4-a97f5f76c9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.840707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955268f-4e65-4809-83f4-a97f5f76c9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.840978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955268f-4e65-4809-83f4-a97f5f76c9f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.848645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab41c14-1f91-4c92-9bab-be5554c46f0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.851455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab41c14-1f91-4c92-9bab-be5554c46f0c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.851800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955268f-4e65-4809-83f4-a97f5f76c9f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.853684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955268f-4e65-4809-83f4-a97f5f76c9f1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.867923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 364/747] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:12.872654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab41c14-1f91-4c92-9bab-be5554c46f0c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.876436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-9955268f-4e65-4809-83f4-a97f5f76c9f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:12.877902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 384/748] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:12.884898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab41c14-1f91-4c92-9bab-be5554c46f0c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.885151 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a434974-1d30-4b02-a292-afa1cc35cf2b None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.885485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a434974-1d30-4b02-a292-afa1cc35cf2b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.885763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a434974-1d30-4b02-a292-afa1cc35cf2b None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.887628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 385/749] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:12.888139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a434974-1d30-4b02-a292-afa1cc35cf2b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.889985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dee58-934d-49f7-846a-bbf8715481eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.891078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dee58-934d-49f7-846a-bbf8715481eb admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.891667 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dee58-934d-49f7-846a-bbf8715481eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.892236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dee58-934d-49f7-846a-bbf8715481eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.901706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a434974-1d30-4b02-a292-afa1cc35cf2b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.905776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dee58-934d-49f7-846a-bbf8715481eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.906171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606eee2-6d9b-483c-bf08-e9f95536c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.906797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606eee2-6d9b-483c-bf08-e9f95536c3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.907075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606eee2-6d9b-483c-bf08-e9f95536c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.907347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606eee2-6d9b-483c-bf08-e9f95536c3b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.908057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606eee2-6d9b-483c-bf08-e9f95536c3b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:12.908377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606eee2-6d9b-483c-bf08-e9f95536c3b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.909342 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dee58-934d-49f7-846a-bbf8715481eb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.909944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606eee2-6d9b-483c-bf08-e9f95536c3b8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.926664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 386/750] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:12.926664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027e9e1-9478-4c01-b149-0d442418fade None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.926664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027e9e1-9478-4c01-b149-0d442418fade None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.926664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027e9e1-9478-4c01-b149-0d442418fade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.927742 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c27dee58-934d-49f7-846a-bbf8715481eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:12.929094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 365/751] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:12.932493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dee58-934d-49f7-846a-bbf8715481eb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.941705 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dee58-934d-49f7-846a-bbf8715481eb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.946650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-1027e9e1-9478-4c01-b149-0d442418fade None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:12.946763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5c99d-be91-4b06-9fc6-7fceb2f40981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.947423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5c99d-be91-4b06-9fc6-7fceb2f40981 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.947707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5c99d-be91-4b06-9fc6-7fceb2f40981 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.947815 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1027e9e1-9478-4c01-b149-0d442418fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:12.947976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5c99d-be91-4b06-9fc6-7fceb2f40981 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.955508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5c99d-be91-4b06-9fc6-7fceb2f40981 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.960395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 387/752] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:12 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:12.960395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027e9e1-9478-4c01-b149-0d442418fade None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.961117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5c99d-be91-4b06-9fc6-7fceb2f40981 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.970629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027e9e1-9478-4c01-b149-0d442418fade None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:12.972924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c9b5c99d-be91-4b06-9fc6-7fceb2f40981 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:25:12.974315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 366/753] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:12.975087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8f3e-7628-4acf-948d-8fbf20346af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:12.975741 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8f3e-7628-4acf-948d-8fbf20346af4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:12.976082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8f3e-7628-4acf-948d-8fbf20346af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:12.976394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8f3e-7628-4acf-948d-8fbf20346af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:12.977097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf8f3e-7628-4acf-948d-8fbf20346af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:12.977396 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf8f3e-7628-4acf-948d-8fbf20346af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:12.978975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf8f3e-7628-4acf-948d-8fbf20346af4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:12.985606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5c99d-be91-4b06-9fc6-7fceb2f40981 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:12.996179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 388/754] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:12.996179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8f3e-7628-4acf-948d-8fbf20346af4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.001528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8f3e-7628-4acf-948d-8fbf20346af4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.002461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5c99d-be91-4b06-9fc6-7fceb2f40981 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.005961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce76cf-9fe2-41ef-a4bc-6a3f9e08522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.006746 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce76cf-9fe2-41ef-a4bc-6a3f9e08522e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.006945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61c82d-4dc6-4dbf-84ed-0f4177dfe3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.007604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce76cf-9fe2-41ef-a4bc-6a3f9e08522e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.007835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce76cf-9fe2-41ef-a4bc-6a3f9e08522e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.008127 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61c82d-4dc6-4dbf-84ed-0f4177dfe3af admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.008431 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61c82d-4dc6-4dbf-84ed-0f4177dfe3af admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.008524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce76cf-9fe2-41ef-a4bc-6a3f9e08522e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.008706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61c82d-4dc6-4dbf-84ed-0f4177dfe3af admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.009532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61c82d-4dc6-4dbf-84ed-0f4177dfe3af admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:13.009835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61c82d-4dc6-4dbf-84ed-0f4177dfe3af admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.010087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce76cf-9fe2-41ef-a4bc-6a3f9e08522e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.011797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61c82d-4dc6-4dbf-84ed-0f4177dfe3af admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.020870 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-29ce76cf-9fe2-41ef-a4bc-6a3f9e08522e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:25:13.022029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 389/755] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:13.023317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce76cf-9fe2-41ef-a4bc-6a3f9e08522e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.035873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 367/756] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 04:25:12 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:13.035873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61c82d-4dc6-4dbf-84ed-0f4177dfe3af admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.037327 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce76cf-9fe2-41ef-a4bc-6a3f9e08522e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.042129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ea934-fe20-43f6-b43e-b19a67d162f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.043251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ea934-fe20-43f6-b43e-b19a67d162f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.043476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ea934-fe20-43f6-b43e-b19a67d162f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.043744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ea934-fe20-43f6-b43e-b19a67d162f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.044284 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61c82d-4dc6-4dbf-84ed-0f4177dfe3af admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.048647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39d94-2477-4545-9bfe-187dde0fd34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.049286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39d94-2477-4545-9bfe-187dde0fd34c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.049568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39d94-2477-4545-9bfe-187dde0fd34c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.049842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39d94-2477-4545-9bfe-187dde0fd34c admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.050543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd39d94-2477-4545-9bfe-187dde0fd34c admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:13.050848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd39d94-2477-4545-9bfe-187dde0fd34c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.051848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ea934-fe20-43f6-b43e-b19a67d162f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.052541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd39d94-2477-4545-9bfe-187dde0fd34c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.053932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ea934-fe20-43f6-b43e-b19a67d162f3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.057671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 368/757] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:13.058134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39d94-2477-4545-9bfe-187dde0fd34c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.067934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39d94-2477-4545-9bfe-187dde0fd34c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.071963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-736ea934-fe20-43f6-b43e-b19a67d162f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:13.072778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b763d2e-5186-46ae-b987-99f697b3a5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.073323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 390/758] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:13.073441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b763d2e-5186-46ae-b987-99f697b3a5cc admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.078743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b763d2e-5186-46ae-b987-99f697b3a5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.078866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ea934-fe20-43f6-b43e-b19a67d162f3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.078954 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b763d2e-5186-46ae-b987-99f697b3a5cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.087445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b763d2e-5186-46ae-b987-99f697b3a5cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.088813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ea934-fe20-43f6-b43e-b19a67d162f3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.089490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b763d2e-5186-46ae-b987-99f697b3a5cc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.093169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094440ed-83e9-4406-8af2-f3e387cb7c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.093808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094440ed-83e9-4406-8af2-f3e387cb7c89 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.094086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094440ed-83e9-4406-8af2-f3e387cb7c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.094354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094440ed-83e9-4406-8af2-f3e387cb7c89 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.095062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094440ed-83e9-4406-8af2-f3e387cb7c89 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:13.095378 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094440ed-83e9-4406-8af2-f3e387cb7c89 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.096992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094440ed-83e9-4406-8af2-f3e387cb7c89 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.102096 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 391/759] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:13.104664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 369/760] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:13.105791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b763d2e-5186-46ae-b987-99f697b3a5cc admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.110515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094440ed-83e9-4406-8af2-f3e387cb7c89 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.115446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b763d2e-5186-46ae-b987-99f697b3a5cc admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.120619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f73b5-12ff-493f-bfae-f0e21330570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.121244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f73b5-12ff-493f-bfae-f0e21330570b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.121522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f73b5-12ff-493f-bfae-f0e21330570b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.121791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f73b5-12ff-493f-bfae-f0e21330570b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.126450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094440ed-83e9-4406-8af2-f3e387cb7c89 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.133522 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6441c-807b-4a31-97a4-e86e7f22a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.134448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f73b5-12ff-493f-bfae-f0e21330570b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.134832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6441c-807b-4a31-97a4-e86e7f22a47e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.135317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6441c-807b-4a31-97a4-e86e7f22a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.135802 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6441c-807b-4a31-97a4-e86e7f22a47e admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.136543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f73b5-12ff-493f-bfae-f0e21330570b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.137203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6441c-807b-4a31-97a4-e86e7f22a47e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:13.137729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6441c-807b-4a31-97a4-e86e7f22a47e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.140548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6441c-807b-4a31-97a4-e86e7f22a47e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.155973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-1c0f73b5-12ff-493f-bfae-f0e21330570b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:13.156707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 392/761] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:13.157701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 370/762] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:13.163739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6441c-807b-4a31-97a4-e86e7f22a47e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.163890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f73b5-12ff-493f-bfae-f0e21330570b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.174390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f73b5-12ff-493f-bfae-f0e21330570b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.176406 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6441c-807b-4a31-97a4-e86e7f22a47e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.179935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ceb07-ed07-42d7-9414-7f08e6336495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.180702 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ceb07-ed07-42d7-9414-7f08e6336495 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.180983 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ceb07-ed07-42d7-9414-7f08e6336495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.181350 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ceb07-ed07-42d7-9414-7f08e6336495 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.182099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ceb07-ed07-42d7-9414-7f08e6336495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:13.182403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ceb07-ed07-42d7-9414-7f08e6336495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.183632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea977474-a46a-4307-b13c-cd4ea71eaaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.184166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ceb07-ed07-42d7-9414-7f08e6336495 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.184796 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea977474-a46a-4307-b13c-cd4ea71eaaff admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.185296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea977474-a46a-4307-b13c-cd4ea71eaaff admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.185768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea977474-a46a-4307-b13c-cd4ea71eaaff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.187652 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea977474-a46a-4307-b13c-cd4ea71eaaff admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=36d3a6eb24b04e14a42d771c9c768ed2) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:13.188196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea977474-a46a-4307-b13c-cd4ea71eaaff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.190419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea977474-a46a-4307-b13c-cd4ea71eaaff admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.199636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 393/763] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/role_assignments?user.id=36d3a6eb24b04e14a42d771c9c768ed2&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:13.203325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 371/764] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:13.204535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea977474-a46a-4307-b13c-cd4ea71eaaff admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.217625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea977474-a46a-4307-b13c-cd4ea71eaaff admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.222908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717885be-2971-4585-94d6-9fac69381a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.224048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717885be-2971-4585-94d6-9fac69381a67 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.224515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717885be-2971-4585-94d6-9fac69381a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.224938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717885be-2971-4585-94d6-9fac69381a67 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.234124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717885be-2971-4585-94d6-9fac69381a67 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.236500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717885be-2971-4585-94d6-9fac69381a67 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.251518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-717885be-2971-4585-94d6-9fac69381a67 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:13.253126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 394/765] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:13.261505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ceb07-ed07-42d7-9414-7f08e6336495 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.272248 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ceb07-ed07-42d7-9414-7f08e6336495 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.280476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5f83d-10a6-4149-af9d-6868a9230339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.281370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5f83d-10a6-4149-af9d-6868a9230339 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.282343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5f83d-10a6-4149-af9d-6868a9230339 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.282343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5f83d-10a6-4149-af9d-6868a9230339 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.283079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5f83d-10a6-4149-af9d-6868a9230339 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:13.283529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5f83d-10a6-4149-af9d-6868a9230339 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.285687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5f83d-10a6-4149-af9d-6868a9230339 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.301126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 372/766] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:13.308332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717885be-2971-4585-94d6-9fac69381a67 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:13.319316 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717885be-2971-4585-94d6-9fac69381a67 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:13.324134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1341e-4b77-4735-8854-f531230d7951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:13.325757 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1341e-4b77-4735-8854-f531230d7951 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:13.326047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1341e-4b77-4735-8854-f531230d7951 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:13.326320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1341e-4b77-4735-8854-f531230d7951 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:13.327229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1341e-4b77-4735-8854-f531230d7951 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=c23aad5d62b84cd7a4da788500148f7e) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:13.327538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1341e-4b77-4735-8854-f531230d7951 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:13.329509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1341e-4b77-4735-8854-f531230d7951 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:13.337566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 395/767] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:13 2021] GET /identity/v3/role_assignments?user.id=c23aad5d62b84cd7a4da788500148f7e&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:14.142429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6693f0-cddb-4bfc-8ffb-7c838f2098eb None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:14.142968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6693f0-cddb-4bfc-8ffb-7c838f2098eb None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:14.143073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6693f0-cddb-4bfc-8ffb-7c838f2098eb None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:14.145156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 373/768] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:14.151356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47783fc1-f37b-4920-9460-7ec84e5c35dc None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:14.151758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47783fc1-f37b-4920-9460-7ec84e5c35dc None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:14.151963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47783fc1-f37b-4920-9460-7ec84e5c35dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:14.170628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-47783fc1-f37b-4920-9460-7ec84e5c35dc None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:14.171842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-47783fc1-f37b-4920-9460-7ec84e5c35dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:14.184464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 396/769] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:14 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:14.205628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6693f0-cddb-4bfc-8ffb-7c838f2098eb None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:14.218674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6693f0-cddb-4bfc-8ffb-7c838f2098eb None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:14.223388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c0888-6b80-4aa5-96c8-8ead100d4b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:14.224054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0888-6b80-4aa5-96c8-8ead100d4b51 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:14.224437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0888-6b80-4aa5-96c8-8ead100d4b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:14.224753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0888-6b80-4aa5-96c8-8ead100d4b51 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:14.225555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c0888-6b80-4aa5-96c8-8ead100d4b51 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:14.227356 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c0888-6b80-4aa5-96c8-8ead100d4b51 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:14.332506 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 374/770] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:25:14 2021] POST /identity/v3/services => generated 269 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:15.485574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99fda8-c8ab-4eee-9359-5b55881a97e4 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.486118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99fda8-c8ab-4eee-9359-5b55881a97e4 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.486118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99fda8-c8ab-4eee-9359-5b55881a97e4 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.488301 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 397/771] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:15.495289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d10f8-62b3-48bf-8c85-f6c8d03a974e None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.495779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d10f8-62b3-48bf-8c85-f6c8d03a974e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.495852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d10f8-62b3-48bf-8c85-f6c8d03a974e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.515242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-578d10f8-62b3-48bf-8c85-f6c8d03a974e None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:15.517265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-578d10f8-62b3-48bf-8c85-f6c8d03a974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:15.524108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6b974-94a5-4816-98c7-d742c3823922 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.524432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6b974-94a5-4816-98c7-d742c3823922 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.524720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6b974-94a5-4816-98c7-d742c3823922 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.526884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 398/772] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:15.533617 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b43dd-4366-4c9d-ae6a-b52d776b31a8 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.534005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b43dd-4366-4c9d-ae6a-b52d776b31a8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.534181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b43dd-4366-4c9d-ae6a-b52d776b31a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.539444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 375/773] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:15 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:15.560037 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-fa5b43dd-4366-4c9d-ae6a-b52d776b31a8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:15.561374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-fa5b43dd-4366-4c9d-ae6a-b52d776b31a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:15.564348 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d10f8-62b3-48bf-8c85-f6c8d03a974e None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:15.571585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 399/774] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:15 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:15.574587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d10f8-62b3-48bf-8c85-f6c8d03a974e None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:15.579338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f9e4b-6b05-475a-908f-cb3821b7fce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:15.580004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9e4b-6b05-475a-908f-cb3821b7fce6 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.580286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9e4b-6b05-475a-908f-cb3821b7fce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.580611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9e4b-6b05-475a-908f-cb3821b7fce6 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.581349 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f9e4b-6b05-475a-908f-cb3821b7fce6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:15.583057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f9e4b-6b05-475a-908f-cb3821b7fce6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:15.599297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b43dd-4366-4c9d-ae6a-b52d776b31a8 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:15.609539 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b43dd-4366-4c9d-ae6a-b52d776b31a8 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:15.614224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce927d59-9a41-42b4-a8ae-c57e4a09514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:15.615047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927d59-9a41-42b4-a8ae-c57e4a09514d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.615327 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927d59-9a41-42b4-a8ae-c57e4a09514d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.615602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927d59-9a41-42b4-a8ae-c57e4a09514d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.627930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce927d59-9a41-42b4-a8ae-c57e4a09514d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:15.636291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-ce927d59-9a41-42b4-a8ae-c57e4a09514d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:25:15.637831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 400/775] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 04:25:15 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:15.639121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5d5bb-10f7-4e8a-8a09-ebdaea3f46e0 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.639415 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5d5bb-10f7-4e8a-8a09-ebdaea3f46e0 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.639674 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5d5bb-10f7-4e8a-8a09-ebdaea3f46e0 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.644424 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 401/776] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:15.646358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5d5bb-10f7-4e8a-8a09-ebdaea3f46e0 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:15.663541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 376/777] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:25:15 2021] POST /identity/v3/services => generated 251 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:25:15.666287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dde1a-ec20-4852-a7e8-24c3591d72c7 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.666785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dde1a-ec20-4852-a7e8-24c3591d72c7 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.667264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dde1a-ec20-4852-a7e8-24c3591d72c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.696113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5d5bb-10f7-4e8a-8a09-ebdaea3f46e0 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:15.702548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a7cb9-8b7a-4003-ba9d-9bcce26a1898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:15.703479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a7cb9-8b7a-4003-ba9d-9bcce26a1898 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.703912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a7cb9-8b7a-4003-ba9d-9bcce26a1898 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.704288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a7cb9-8b7a-4003-ba9d-9bcce26a1898 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.705259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a7cb9-8b7a-4003-ba9d-9bcce26a1898 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:15.705669 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a7cb9-8b7a-4003-ba9d-9bcce26a1898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:15.708227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a7cb9-8b7a-4003-ba9d-9bcce26a1898 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:15.717314 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-8e0dde1a-ec20-4852-a7e8-24c3591d72c7 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:15.724183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 402/778] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 04:25:15 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:15.724462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8e0dde1a-ec20-4852-a7e8-24c3591d72c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:15.729133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a7cb9-8b7a-4003-ba9d-9bcce26a1898 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:15.738298 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 377/779] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:15 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:15.743592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a7cb9-8b7a-4003-ba9d-9bcce26a1898 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:15.751537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b577aab-600b-4f78-a0e2-b004b8e77f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:15.753338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b577aab-600b-4f78-a0e2-b004b8e77f24 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.754148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b577aab-600b-4f78-a0e2-b004b8e77f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.754842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b577aab-600b-4f78-a0e2-b004b8e77f24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.765425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dde1a-ec20-4852-a7e8-24c3591d72c7 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:15.773844 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b577aab-600b-4f78-a0e2-b004b8e77f24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:15.776395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b577aab-600b-4f78-a0e2-b004b8e77f24 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:15.781701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dde1a-ec20-4852-a7e8-24c3591d72c7 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:15.789990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbac02-04e4-435f-ad3b-060d900c33c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:15.791681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbac02-04e4-435f-ad3b-060d900c33c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.792478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbac02-04e4-435f-ad3b-060d900c33c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.793493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbac02-04e4-435f-ad3b-060d900c33c8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.794954 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbac02-04e4-435f-ad3b-060d900c33c8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:15.795915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-2b577aab-600b-4f78-a0e2-b004b8e77f24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:15.797604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 403/780] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:15.805670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbac02-04e4-435f-ad3b-060d900c33c8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:15.810967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b577aab-600b-4f78-a0e2-b004b8e77f24 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:15.823065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b577aab-600b-4f78-a0e2-b004b8e77f24 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:15.828548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5869ca-129f-4410-9465-7cbc29fd9fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:15.829673 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c2cbac02-04e4-435f-ad3b-060d900c33c8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:25:15.830073 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5869ca-129f-4410-9465-7cbc29fd9fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.830598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5869ca-129f-4410-9465-7cbc29fd9fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.831307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5869ca-129f-4410-9465-7cbc29fd9fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.837074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5869ca-129f-4410-9465-7cbc29fd9fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:15.837282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 378/781] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:15 2021] GET /identity/v3/services/object-store => generated 93 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:15.837361 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5869ca-129f-4410-9465-7cbc29fd9fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:15.838165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5869ca-129f-4410-9465-7cbc29fd9fb0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:15.840249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbac02-04e4-435f-ad3b-060d900c33c8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:15.853611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbac02-04e4-435f-ad3b-060d900c33c8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:15.858818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368cb61-6b7d-4e65-8755-f899a49079df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:15.859553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368cb61-6b7d-4e65-8755-f899a49079df admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.864434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368cb61-6b7d-4e65-8755-f899a49079df admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.864434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368cb61-6b7d-4e65-8755-f899a49079df admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.864434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368cb61-6b7d-4e65-8755-f899a49079df admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:15.864434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368cb61-6b7d-4e65-8755-f899a49079df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:15.864434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368cb61-6b7d-4e65-8755-f899a49079df admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:15.864870 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 404/782] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:15.868631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5869ca-129f-4410-9465-7cbc29fd9fb0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:15.872407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 379/783] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 04:25:15 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:15.876665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368cb61-6b7d-4e65-8755-f899a49079df admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:15.885304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5869ca-129f-4410-9465-7cbc29fd9fb0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:15.886781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368cb61-6b7d-4e65-8755-f899a49079df admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:15.891252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0e419-3ac4-44ce-ac19-cc1cc5085557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:15.891550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99666100-f10f-4d34-84a0-258687e2b423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:15.892240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99666100-f10f-4d34-84a0-258687e2b423 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.892566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99666100-f10f-4d34-84a0-258687e2b423 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.892845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99666100-f10f-4d34-84a0-258687e2b423 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.893140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0e419-3ac4-44ce-ac19-cc1cc5085557 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.893428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0e419-3ac4-44ce-ac19-cc1cc5085557 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.893598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99666100-f10f-4d34-84a0-258687e2b423 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:15.893734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0e419-3ac4-44ce-ac19-cc1cc5085557 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.893870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99666100-f10f-4d34-84a0-258687e2b423 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:15.895512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99666100-f10f-4d34-84a0-258687e2b423 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:15.902354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 380/784] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 04:25:15 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:15.902945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0e419-3ac4-44ce-ac19-cc1cc5085557 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:15.905053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0e419-3ac4-44ce-ac19-cc1cc5085557 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:15.923934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-aac0e419-3ac4-44ce-ac19-cc1cc5085557 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:25:15.925591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 405/785] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 04:25:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:15.933954 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99666100-f10f-4d34-84a0-258687e2b423 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:15.946466 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99666100-f10f-4d34-84a0-258687e2b423 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:15.951528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb718def-02c4-4727-bb42-6ab78ee54f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:15.952294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb718def-02c4-4727-bb42-6ab78ee54f9a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:15.952748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb718def-02c4-4727-bb42-6ab78ee54f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:15.953127 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb718def-02c4-4727-bb42-6ab78ee54f9a admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:15.954161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb718def-02c4-4727-bb42-6ab78ee54f9a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:15.954469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb718def-02c4-4727-bb42-6ab78ee54f9a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:15.956689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb718def-02c4-4727-bb42-6ab78ee54f9a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:15.982957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 381/786] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 04:25:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:15.989645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0e419-3ac4-44ce-ac19-cc1cc5085557 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.000825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0e419-3ac4-44ce-ac19-cc1cc5085557 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.005761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043f45-5dba-4993-b12c-080803eaec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.006484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043f45-5dba-4993-b12c-080803eaec9c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.006766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043f45-5dba-4993-b12c-080803eaec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.007075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043f45-5dba-4993-b12c-080803eaec9c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.017750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca043f45-5dba-4993-b12c-080803eaec9c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.019615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca043f45-5dba-4993-b12c-080803eaec9c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.030124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 406/787] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:15 2021] GET /identity/v3/auth/tokens => generated 1816 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:16.036713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb718def-02c4-4727-bb42-6ab78ee54f9a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.048035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb718def-02c4-4727-bb42-6ab78ee54f9a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.053139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b929ba-2ee0-4cbb-824a-41d9b6e13276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.054538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b929ba-2ee0-4cbb-824a-41d9b6e13276 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.054829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b929ba-2ee0-4cbb-824a-41d9b6e13276 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.055158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b929ba-2ee0-4cbb-824a-41d9b6e13276 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.067581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b929ba-2ee0-4cbb-824a-41d9b6e13276 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.069698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b929ba-2ee0-4cbb-824a-41d9b6e13276 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.088694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-19b929ba-2ee0-4cbb-824a-41d9b6e13276 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:16.091279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 382/788] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:16.096748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043f45-5dba-4993-b12c-080803eaec9c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.106528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043f45-5dba-4993-b12c-080803eaec9c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.111299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283de78-2ef2-4914-816d-87a62cd586ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.112030 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283de78-2ef2-4914-816d-87a62cd586ae admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.112336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283de78-2ef2-4914-816d-87a62cd586ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.112981 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283de78-2ef2-4914-816d-87a62cd586ae admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.114409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283de78-2ef2-4914-816d-87a62cd586ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:16.114956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283de78-2ef2-4914-816d-87a62cd586ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.118631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283de78-2ef2-4914-816d-87a62cd586ae admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.133592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 407/789] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:16.139826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b929ba-2ee0-4cbb-824a-41d9b6e13276 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.150448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b929ba-2ee0-4cbb-824a-41d9b6e13276 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.155291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0b7be-d2bf-4c58-8365-ad75b21a6c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.156139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0b7be-d2bf-4c58-8365-ad75b21a6c09 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.156450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0b7be-d2bf-4c58-8365-ad75b21a6c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.156730 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0b7be-d2bf-4c58-8365-ad75b21a6c09 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.165165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0b7be-d2bf-4c58-8365-ad75b21a6c09 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.167222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0b7be-d2bf-4c58-8365-ad75b21a6c09 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.181867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-f4f0b7be-d2bf-4c58-8365-ad75b21a6c09 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:16.183377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 383/790] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:16.189722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283de78-2ef2-4914-816d-87a62cd586ae admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.200594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283de78-2ef2-4914-816d-87a62cd586ae admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.204672 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ab79b-307b-4339-b5ff-aa318ff94ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.205506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab79b-307b-4339-b5ff-aa318ff94ffa admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.205947 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab79b-307b-4339-b5ff-aa318ff94ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.206357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab79b-307b-4339-b5ff-aa318ff94ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.207283 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ab79b-307b-4339-b5ff-aa318ff94ffa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:16.207729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ab79b-307b-4339-b5ff-aa318ff94ffa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.209733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ab79b-307b-4339-b5ff-aa318ff94ffa admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.223322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 408/791] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:16.230241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0b7be-d2bf-4c58-8365-ad75b21a6c09 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.240977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0b7be-d2bf-4c58-8365-ad75b21a6c09 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.245684 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ff601-2172-4c9d-8fbe-4c2c07f9cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.246384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff601-2172-4c9d-8fbe-4c2c07f9cd0c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.246662 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff601-2172-4c9d-8fbe-4c2c07f9cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.246941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff601-2172-4c9d-8fbe-4c2c07f9cd0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.247827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ff601-2172-4c9d-8fbe-4c2c07f9cd0c admin admin] RBAC: Adding query filter params (role.id=a32916cfae1a48aa8c0f718bc14b2cb4, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=36d3a6eb24b04e14a42d771c9c768ed2) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:16.248138 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ff601-2172-4c9d-8fbe-4c2c07f9cd0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.250133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ff601-2172-4c9d-8fbe-4c2c07f9cd0c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.256438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 384/792] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:16 2021] GET /identity/v3/role_assignments?user.id=36d3a6eb24b04e14a42d771c9c768ed2&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=a32916cfae1a48aa8c0f718bc14b2cb4 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:16.604819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b5549-4160-4f90-8228-dd5ca888cb45 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.605655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b5549-4160-4f90-8228-dd5ca888cb45 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.606072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b5549-4160-4f90-8228-dd5ca888cb45 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.607978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 409/793] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:16.614668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf3840-4d5a-4bf8-8193-ec12be565aae None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.615130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf3840-4d5a-4bf8-8193-ec12be565aae None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.615414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf3840-4d5a-4bf8-8193-ec12be565aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.634003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e1cf3840-4d5a-4bf8-8193-ec12be565aae None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:16.635256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e1cf3840-4d5a-4bf8-8193-ec12be565aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:16.643214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 385/794] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:16 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:16.667197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b5549-4160-4f90-8228-dd5ca888cb45 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.679825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b5549-4160-4f90-8228-dd5ca888cb45 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.684363 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce3fb5-0397-48ed-b637-65f0398431e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.685183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce3fb5-0397-48ed-b637-65f0398431e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.685463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce3fb5-0397-48ed-b637-65f0398431e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.685734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce3fb5-0397-48ed-b637-65f0398431e9 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.686385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce3fb5-0397-48ed-b637-65f0398431e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.688049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce3fb5-0397-48ed-b637-65f0398431e9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.700054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-87ce3fb5-0397-48ed-b637-65f0398431e9 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:25:16.701563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 410/795] 10.222.0.25 () {56 vars in 1154 bytes} [Fri Aug 27 04:25:16 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:16.708284 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf3840-4d5a-4bf8-8193-ec12be565aae None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.718016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf3840-4d5a-4bf8-8193-ec12be565aae None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.722595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216fc47-4866-4a39-a0da-f32273641670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.723255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216fc47-4866-4a39-a0da-f32273641670 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.723536 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216fc47-4866-4a39-a0da-f32273641670 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.723813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216fc47-4866-4a39-a0da-f32273641670 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.724569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216fc47-4866-4a39-a0da-f32273641670 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:16.724878 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216fc47-4866-4a39-a0da-f32273641670 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.726523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216fc47-4866-4a39-a0da-f32273641670 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.731629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 386/796] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:16 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:16.737908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce3fb5-0397-48ed-b637-65f0398431e9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.747763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce3fb5-0397-48ed-b637-65f0398431e9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.752465 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e92056-77f0-4aad-85a9-84257eac079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.753123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92056-77f0-4aad-85a9-84257eac079f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.753464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92056-77f0-4aad-85a9-84257eac079f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.753743 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92056-77f0-4aad-85a9-84257eac079f admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.754504 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e92056-77f0-4aad-85a9-84257eac079f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:16.754813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e92056-77f0-4aad-85a9-84257eac079f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.756435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e92056-77f0-4aad-85a9-84257eac079f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.762356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 411/797] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:16 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:16.768662 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216fc47-4866-4a39-a0da-f32273641670 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.779186 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216fc47-4866-4a39-a0da-f32273641670 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.783870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95d17b-1408-4935-8959-84372307e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.784604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95d17b-1408-4935-8959-84372307e14e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.784890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95d17b-1408-4935-8959-84372307e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.785216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95d17b-1408-4935-8959-84372307e14e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.786068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95d17b-1408-4935-8959-84372307e14e admin admin] RBAC: Adding query filter params (interface=public, service_id=11624661066146a8b694931868b71469, region_id=RegionOne) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:16.786380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95d17b-1408-4935-8959-84372307e14e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.788150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95d17b-1408-4935-8959-84372307e14e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.795666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 387/798] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 04:25:16 2021] GET /identity/v3/endpoints?service_id=11624661066146a8b694931868b71469&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:16.802646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e92056-77f0-4aad-85a9-84257eac079f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:16.812915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e92056-77f0-4aad-85a9-84257eac079f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:16.818134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b6c85-43f6-40ce-9f44-48db6df2aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:16.819050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b6c85-43f6-40ce-9f44-48db6df2aede admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:16.820065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b6c85-43f6-40ce-9f44-48db6df2aede admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:16.820369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b6c85-43f6-40ce-9f44-48db6df2aede admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:16.821270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b6c85-43f6-40ce-9f44-48db6df2aede admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:16.823089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b6c85-43f6-40ce-9f44-48db6df2aede admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:16.830270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 412/799] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:25:16 2021] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:25:17.995231 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cac1b-f4fa-4b7f-982f-13e0a229263d None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:17.995724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cac1b-f4fa-4b7f-982f-13e0a229263d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:17.995724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cac1b-f4fa-4b7f-982f-13e0a229263d None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:17.997806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 388/800] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:18.004659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54f62-e123-4192-b571-97e957b8601e None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.005156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54f62-e123-4192-b571-97e957b8601e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.005226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54f62-e123-4192-b571-97e957b8601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.025225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-95d54f62-e123-4192-b571-97e957b8601e None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:18.026460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-95d54f62-e123-4192-b571-97e957b8601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:18.040492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 413/801] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:18 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:18.060630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cac1b-f4fa-4b7f-982f-13e0a229263d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.076293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cac1b-f4fa-4b7f-982f-13e0a229263d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.082625 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35379f2-52d3-4125-a6de-b9af47073c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.083475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35379f2-52d3-4125-a6de-b9af47073c65 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.083767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35379f2-52d3-4125-a6de-b9af47073c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.084045 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35379f2-52d3-4125-a6de-b9af47073c65 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.085818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35379f2-52d3-4125-a6de-b9af47073c65 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.088096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35379f2-52d3-4125-a6de-b9af47073c65 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.100306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-e35379f2-52d3-4125-a6de-b9af47073c65 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:25:18.107476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 389/802] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:18.109008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54f62-e123-4192-b571-97e957b8601e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.118437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54f62-e123-4192-b571-97e957b8601e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.123016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f441a-f0c7-466b-afc2-3b325031c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.123681 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f441a-f0c7-466b-afc2-3b325031c128 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.123962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f441a-f0c7-466b-afc2-3b325031c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.124237 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f441a-f0c7-466b-afc2-3b325031c128 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.124989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f441a-f0c7-466b-afc2-3b325031c128 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:18.125290 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f441a-f0c7-466b-afc2-3b325031c128 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.126942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f441a-f0c7-466b-afc2-3b325031c128 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.136474 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 414/803] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:18.139266 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35379f2-52d3-4125-a6de-b9af47073c65 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.149694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35379f2-52d3-4125-a6de-b9af47073c65 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.154245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f1f2c-58e6-4dd0-babc-a5088049433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.154904 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f1f2c-58e6-4dd0-babc-a5088049433e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.155187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f1f2c-58e6-4dd0-babc-a5088049433e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.155463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f1f2c-58e6-4dd0-babc-a5088049433e admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.156177 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f1f2c-58e6-4dd0-babc-a5088049433e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:18.156524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f1f2c-58e6-4dd0-babc-a5088049433e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.158143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f1f2c-58e6-4dd0-babc-a5088049433e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.168469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 390/804] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:18.170427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f441a-f0c7-466b-afc2-3b325031c128 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.177857 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1733c-cf11-4d2d-abfb-8a44d05bcca9 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.178149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1733c-cf11-4d2d-abfb-8a44d05bcca9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.178429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1733c-cf11-4d2d-abfb-8a44d05bcca9 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.180425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 391/805] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:18.184201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f441a-f0c7-466b-afc2-3b325031c128 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.187081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb1b1a-3715-43d3-96a5-ef5b91c284ae None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.187366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb1b1a-3715-43d3-96a5-ef5b91c284ae None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.187643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb1b1a-3715-43d3-96a5-ef5b91c284ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.189951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4b18a-7f61-40ba-8442-65b1e28dc3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.190852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4b18a-7f61-40ba-8442-65b1e28dc3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.191385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4b18a-7f61-40ba-8442-65b1e28dc3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.191833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4b18a-7f61-40ba-8442-65b1e28dc3c6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.192948 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4b18a-7f61-40ba-8442-65b1e28dc3c6 admin admin] RBAC: Adding query filter params (interface=public, service_id=1e394627dc6948f0972e386a07f93542, region_id=RegionOne) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:18.193457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4b18a-7f61-40ba-8442-65b1e28dc3c6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.195774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4b18a-7f61-40ba-8442-65b1e28dc3c6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.204463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 415/806] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/endpoints?service_id=1e394627dc6948f0972e386a07f93542&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:18.207748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2afb1b1a-3715-43d3-96a5-ef5b91c284ae None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:18.208486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4b18a-7f61-40ba-8442-65b1e28dc3c6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.208990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2afb1b1a-3715-43d3-96a5-ef5b91c284ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:18.218676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 392/807] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:18 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:18.220072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4b18a-7f61-40ba-8442-65b1e28dc3c6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.227351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e10366-e472-4126-bfd5-f65dd2f92882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.228252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10366-e472-4126-bfd5-f65dd2f92882 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.228810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10366-e472-4126-bfd5-f65dd2f92882 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.229297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10366-e472-4126-bfd5-f65dd2f92882 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.230225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e10366-e472-4126-bfd5-f65dd2f92882 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.232129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e10366-e472-4126-bfd5-f65dd2f92882 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.242009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 416/808] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/services => generated 1268 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:25:18.243241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb1b1a-3715-43d3-96a5-ef5b91c284ae None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.253320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb1b1a-3715-43d3-96a5-ef5b91c284ae None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.258514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436f429-c815-4a37-86b2-bfd16469a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.259191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f429-c815-4a37-86b2-bfd16469a8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.259472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f429-c815-4a37-86b2-bfd16469a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.259747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f429-c815-4a37-86b2-bfd16469a8e3 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.260572 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436f429-c815-4a37-86b2-bfd16469a8e3 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.262224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436f429-c815-4a37-86b2-bfd16469a8e3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.363902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 393/809] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:25:18 2021] POST /identity/v3/services => generated 241 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:18.481059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f07ee-7b5c-4317-85d4-c5c5f4ba1672 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.481524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f07ee-7b5c-4317-85d4-c5c5f4ba1672 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.481866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f07ee-7b5c-4317-85d4-c5c5f4ba1672 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.484379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 417/810] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:18.492138 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02699174-03cd-4682-9333-cf36d98253f3 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.492494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02699174-03cd-4682-9333-cf36d98253f3 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.492806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02699174-03cd-4682-9333-cf36d98253f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.516028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-02699174-03cd-4682-9333-cf36d98253f3 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:18.517842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-02699174-03cd-4682-9333-cf36d98253f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:18.538084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 394/811] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:18 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:18.564071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f07ee-7b5c-4317-85d4-c5c5f4ba1672 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.577755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f07ee-7b5c-4317-85d4-c5c5f4ba1672 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.582611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfe5cc-268b-4791-aa5d-eacca927d8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.592263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe5cc-268b-4791-aa5d-eacca927d8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.592263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe5cc-268b-4791-aa5d-eacca927d8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.592263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe5cc-268b-4791-aa5d-eacca927d8c2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.595193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfe5cc-268b-4791-aa5d-eacca927d8c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:18.603040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-85dfe5cc-268b-4791-aa5d-eacca927d8c2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:25:18.604895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 418/812] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:18.611645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02699174-03cd-4682-9333-cf36d98253f3 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.622745 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02699174-03cd-4682-9333-cf36d98253f3 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.631693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf6113-bd3c-4c07-8801-3606555f2a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.632973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf6113-bd3c-4c07-8801-3606555f2a27 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.633254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf6113-bd3c-4c07-8801-3606555f2a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.633528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf6113-bd3c-4c07-8801-3606555f2a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.634289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf6113-bd3c-4c07-8801-3606555f2a27 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:18.634598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf6113-bd3c-4c07-8801-3606555f2a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.636237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf6113-bd3c-4c07-8801-3606555f2a27 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.647702 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 395/813] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:18.653780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfe5cc-268b-4791-aa5d-eacca927d8c2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.664562 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfe5cc-268b-4791-aa5d-eacca927d8c2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.669346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9a73-4f23-4859-a310-4ffb20c312db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.670119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9a73-4f23-4859-a310-4ffb20c312db admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.670409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9a73-4f23-4859-a310-4ffb20c312db admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.670685 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9a73-4f23-4859-a310-4ffb20c312db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.684379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9a73-4f23-4859-a310-4ffb20c312db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.684547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9a73-4f23-4859-a310-4ffb20c312db admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.709236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-9e9c9a73-4f23-4859-a310-4ffb20c312db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:18.710805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 419/814] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:18.716905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf6113-bd3c-4c07-8801-3606555f2a27 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.727501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf6113-bd3c-4c07-8801-3606555f2a27 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.732583 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b843-6b73-4d83-a37a-0393060056a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.733561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b843-6b73-4d83-a37a-0393060056a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.734027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b843-6b73-4d83-a37a-0393060056a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.734502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b843-6b73-4d83-a37a-0393060056a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.735460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377b843-6b73-4d83-a37a-0393060056a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:18.735953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377b843-6b73-4d83-a37a-0393060056a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.737870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377b843-6b73-4d83-a37a-0393060056a0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.751307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 396/815] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:18.758358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9a73-4f23-4859-a310-4ffb20c312db admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.768869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9a73-4f23-4859-a310-4ffb20c312db admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.774009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4db0d-a77e-4edb-8554-dd924338dcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.775072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4db0d-a77e-4edb-8554-dd924338dcff admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.775616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4db0d-a77e-4edb-8554-dd924338dcff admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.776093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4db0d-a77e-4edb-8554-dd924338dcff admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.784244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4db0d-a77e-4edb-8554-dd924338dcff admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.786622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4db0d-a77e-4edb-8554-dd924338dcff admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.802640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-96f4db0d-a77e-4edb-8554-dd924338dcff admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:25:18.805042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 420/816] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:18.811857 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b843-6b73-4d83-a37a-0393060056a0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.822384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b843-6b73-4d83-a37a-0393060056a0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.827407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198fcd5-efd4-4acd-9962-0dbdd1f3ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.828320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198fcd5-efd4-4acd-9962-0dbdd1f3ac4c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.828817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198fcd5-efd4-4acd-9962-0dbdd1f3ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.829307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198fcd5-efd4-4acd-9962-0dbdd1f3ac4c admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.830360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198fcd5-efd4-4acd-9962-0dbdd1f3ac4c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:18.830896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198fcd5-efd4-4acd-9962-0dbdd1f3ac4c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.833079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198fcd5-efd4-4acd-9962-0dbdd1f3ac4c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.853289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 397/817] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:18.859374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4db0d-a77e-4edb-8554-dd924338dcff admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.870054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4db0d-a77e-4edb-8554-dd924338dcff admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.875022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a8825-9576-4d2d-b855-c04028c4222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.876033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a8825-9576-4d2d-b855-c04028c4222a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.876554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a8825-9576-4d2d-b855-c04028c4222a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.877051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a8825-9576-4d2d-b855-c04028c4222a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.887556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a8825-9576-4d2d-b855-c04028c4222a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.889691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a8825-9576-4d2d-b855-c04028c4222a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.906742 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-582a8825-9576-4d2d-b855-c04028c4222a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:18.908522 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 421/818] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:18.915610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198fcd5-efd4-4acd-9962-0dbdd1f3ac4c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.926283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198fcd5-efd4-4acd-9962-0dbdd1f3ac4c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.931903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e40f35-0847-4de5-8262-3c2a3e17d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.932825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e40f35-0847-4de5-8262-3c2a3e17d7de admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.933371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e40f35-0847-4de5-8262-3c2a3e17d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.933873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e40f35-0847-4de5-8262-3c2a3e17d7de admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.934857 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e40f35-0847-4de5-8262-3c2a3e17d7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:18.935366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e40f35-0847-4de5-8262-3c2a3e17d7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.937307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e40f35-0847-4de5-8262-3c2a3e17d7de admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.949985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 398/819] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:18.956565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a8825-9576-4d2d-b855-c04028c4222a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:18.967306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a8825-9576-4d2d-b855-c04028c4222a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:18.972487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e42a49-d937-4a5b-a31e-ad0058fcac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:18.973626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e42a49-d937-4a5b-a31e-ad0058fcac9f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:18.974168 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e42a49-d937-4a5b-a31e-ad0058fcac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:18.974698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e42a49-d937-4a5b-a31e-ad0058fcac9f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:18.982996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e42a49-d937-4a5b-a31e-ad0058fcac9f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:18.985394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e42a49-d937-4a5b-a31e-ad0058fcac9f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:18.999487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-76e42a49-d937-4a5b-a31e-ad0058fcac9f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:19.001262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 422/820] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:19.007905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e40f35-0847-4de5-8262-3c2a3e17d7de admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:19.018584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e40f35-0847-4de5-8262-3c2a3e17d7de admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:19.023813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3a49b-c07a-4fd0-8d9b-63386f81e595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:19.024796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3a49b-c07a-4fd0-8d9b-63386f81e595 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:19.025306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3a49b-c07a-4fd0-8d9b-63386f81e595 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:19.025836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3a49b-c07a-4fd0-8d9b-63386f81e595 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:19.026829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3a49b-c07a-4fd0-8d9b-63386f81e595 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:19.027375 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3a49b-c07a-4fd0-8d9b-63386f81e595 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:19.029581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3a49b-c07a-4fd0-8d9b-63386f81e595 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:19.043945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 399/821] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:19.050865 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e42a49-d937-4a5b-a31e-ad0058fcac9f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:19.063051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e42a49-d937-4a5b-a31e-ad0058fcac9f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:19.068264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c58649-368f-4164-8f47-a1882f8f783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:19.069483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c58649-368f-4164-8f47-a1882f8f783a admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:19.069990 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c58649-368f-4164-8f47-a1882f8f783a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:19.070522 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c58649-368f-4164-8f47-a1882f8f783a admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/36d3a6eb24b04e14a42d771c9c768ed2/roles/a32916cfae1a48aa8c0f718bc14b2cb4` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:19.073076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c58649-368f-4164-8f47-a1882f8f783a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=36d3a6eb24b04e14a42d771c9c768ed2, role_id=a32916cfae1a48aa8c0f718bc14b2cb4)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:19.076180 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c58649-368f-4164-8f47-a1882f8f783a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:19.170779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262698a-d870-41d6-b468-0165ac4d98b2 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:19.171230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262698a-d870-41d6-b468-0165ac4d98b2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:19.171635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262698a-d870-41d6-b468-0165ac4d98b2 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:19.173575 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 400/822] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:19.179873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf34dd-38d0-44f7-915c-f55418f6aa85 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:19.180228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf34dd-38d0-44f7-915c-f55418f6aa85 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:19.181139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf34dd-38d0-44f7-915c-f55418f6aa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:19.198482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3ccf34dd-38d0-44f7-915c-f55418f6aa85 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:19.199825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3ccf34dd-38d0-44f7-915c-f55418f6aa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:19.213419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 423/823] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:25:19 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/36d3a6eb24b04e14a42d771c9c768ed2/roles/a32916cfae1a48aa8c0f718bc14b2cb4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:25:19.222139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 401/824] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:19 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:19.248756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c58649-368f-4164-8f47-a1882f8f783a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:19.323717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c58649-368f-4164-8f47-a1882f8f783a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:19.328936 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58abc26-86b1-4fc0-bb67-32d3555a7260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:19.330056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58abc26-86b1-4fc0-bb67-32d3555a7260 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:19.330486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58abc26-86b1-4fc0-bb67-32d3555a7260 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:19.330927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58abc26-86b1-4fc0-bb67-32d3555a7260 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:19.331840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58abc26-86b1-4fc0-bb67-32d3555a7260 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:19.333796 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58abc26-86b1-4fc0-bb67-32d3555a7260 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:19.347131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-c58abc26-86b1-4fc0-bb67-32d3555a7260 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:25:19.349052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 424/825] 10.222.0.25 () {56 vars in 1154 bytes} [Fri Aug 27 04:25:19 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:19.356883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf34dd-38d0-44f7-915c-f55418f6aa85 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:19.367066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf34dd-38d0-44f7-915c-f55418f6aa85 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:19.371933 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eefca2-1b65-4a2d-96d6-7f4ddab65c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:19.372795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefca2-1b65-4a2d-96d6-7f4ddab65c2d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:19.373183 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefca2-1b65-4a2d-96d6-7f4ddab65c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:19.373564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefca2-1b65-4a2d-96d6-7f4ddab65c2d admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:19.374405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eefca2-1b65-4a2d-96d6-7f4ddab65c2d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:19.374820 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eefca2-1b65-4a2d-96d6-7f4ddab65c2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:19.376622 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eefca2-1b65-4a2d-96d6-7f4ddab65c2d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:19.382623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 402/826] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:19 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:19.389004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58abc26-86b1-4fc0-bb67-32d3555a7260 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:19.400128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58abc26-86b1-4fc0-bb67-32d3555a7260 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:19.410698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d726e4-cdcf-4bc2-bab1-b968b384b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:19.411578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d726e4-cdcf-4bc2-bab1-b968b384b70e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:19.412038 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d726e4-cdcf-4bc2-bab1-b968b384b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:19.412540 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d726e4-cdcf-4bc2-bab1-b968b384b70e admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:19.413403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d726e4-cdcf-4bc2-bab1-b968b384b70e admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:19.413865 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d726e4-cdcf-4bc2-bab1-b968b384b70e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:19.415587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d726e4-cdcf-4bc2-bab1-b968b384b70e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:19.422745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 425/827] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:19 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:19.430627 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eefca2-1b65-4a2d-96d6-7f4ddab65c2d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:19.443471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eefca2-1b65-4a2d-96d6-7f4ddab65c2d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:19.449052 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d8e62-5254-49b2-82a2-300816d7f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:19.449788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d8e62-5254-49b2-82a2-300816d7f402 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:19.450074 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d8e62-5254-49b2-82a2-300816d7f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:19.450351 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d8e62-5254-49b2-82a2-300816d7f402 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:19.451249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d8e62-5254-49b2-82a2-300816d7f402 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:19.453092 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d8e62-5254-49b2-82a2-300816d7f402 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:19.539094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 403/828] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 04:25:19 2021] POST /identity/v3/endpoints => generated 347 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:20.449432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b398-c1c6-4ebf-8ad8-f854105dac72 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.449961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b398-c1c6-4ebf-8ad8-f854105dac72 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.449961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b398-c1c6-4ebf-8ad8-f854105dac72 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.452139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 426/829] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:20.458747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669b8e-ae4a-4fc1-b0d2-a5b48262929b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.459260 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669b8e-ae4a-4fc1-b0d2-a5b48262929b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.459337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669b8e-ae4a-4fc1-b0d2-a5b48262929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.478076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-9c669b8e-ae4a-4fc1-b0d2-a5b48262929b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:20.479286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9c669b8e-ae4a-4fc1-b0d2-a5b48262929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:20.498212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 404/830] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:20 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:20.523206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94b398-c1c6-4ebf-8ad8-f854105dac72 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:20.535894 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94b398-c1c6-4ebf-8ad8-f854105dac72 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:20.540739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d6617-238a-4d5c-9070-d0aa44580ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:20.541758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d6617-238a-4d5c-9070-d0aa44580ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.542263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d6617-238a-4d5c-9070-d0aa44580ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.543075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d6617-238a-4d5c-9070-d0aa44580ae0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.543969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d6617-238a-4d5c-9070-d0aa44580ae0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:20.545818 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d6617-238a-4d5c-9070-d0aa44580ae0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:20.557454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-5b2d6617-238a-4d5c-9070-d0aa44580ae0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:25:20.564450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 427/831] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:25:20 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:20.566331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c669b8e-ae4a-4fc1-b0d2-a5b48262929b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:20.576193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c669b8e-ae4a-4fc1-b0d2-a5b48262929b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:20.580883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150750-8f33-4fcb-b577-d74610e61cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:20.581597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150750-8f33-4fcb-b577-d74610e61cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.581887 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150750-8f33-4fcb-b577-d74610e61cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.582168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150750-8f33-4fcb-b577-d74610e61cf8 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.582889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150750-8f33-4fcb-b577-d74610e61cf8 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:20.583200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150750-8f33-4fcb-b577-d74610e61cf8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:20.584841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150750-8f33-4fcb-b577-d74610e61cf8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:20.590902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 405/832] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:25:20 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:20.597143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d6617-238a-4d5c-9070-d0aa44580ae0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:20.607125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d6617-238a-4d5c-9070-d0aa44580ae0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:20.611957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f6fbf-91ee-4c22-81cb-dfd7d6e97620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:20.612861 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f6fbf-91ee-4c22-81cb-dfd7d6e97620 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.613323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f6fbf-91ee-4c22-81cb-dfd7d6e97620 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.613791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f6fbf-91ee-4c22-81cb-dfd7d6e97620 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.614688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f6fbf-91ee-4c22-81cb-dfd7d6e97620 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:20.615166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f6fbf-91ee-4c22-81cb-dfd7d6e97620 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:20.617018 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f6fbf-91ee-4c22-81cb-dfd7d6e97620 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:20.627448 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 428/833] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 04:25:20 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:20.629054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150750-8f33-4fcb-b577-d74610e61cf8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:20.642345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150750-8f33-4fcb-b577-d74610e61cf8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:20.648326 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8d6f3-3beb-41f7-ba27-9037402e8a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:20.649139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8d6f3-3beb-41f7-ba27-9037402e8a9b admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.649543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8d6f3-3beb-41f7-ba27-9037402e8a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.649890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8d6f3-3beb-41f7-ba27-9037402e8a9b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.650745 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8d6f3-3beb-41f7-ba27-9037402e8a9b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:20.652634 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8d6f3-3beb-41f7-ba27-9037402e8a9b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:20.723966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289249-a1c3-413c-bde8-ac9eeb42070f None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.724652 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289249-a1c3-413c-bde8-ac9eeb42070f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.725257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289249-a1c3-413c-bde8-ac9eeb42070f None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.732091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 406/835] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 04:25:20 2021] POST /identity/v3/endpoints => generated 346 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:25:20.732304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 429/835] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:20.734444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b50b1-8eec-4b8f-8175-f9ac895f1497 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.735030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b50b1-8eec-4b8f-8175-f9ac895f1497 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.735530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b50b1-8eec-4b8f-8175-f9ac895f1497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.756808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-558b50b1-8eec-4b8f-8175-f9ac895f1497 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:20.758729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-558b50b1-8eec-4b8f-8175-f9ac895f1497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:20.778223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 407/836] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:20 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:20.802376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a289249-a1c3-413c-bde8-ac9eeb42070f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:20.816953 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a289249-a1c3-413c-bde8-ac9eeb42070f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:20.822717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a503-f048-4ac8-8511-c852e6df34dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:20.823666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a503-f048-4ac8-8511-c852e6df34dc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.823949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a503-f048-4ac8-8511-c852e6df34dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.824225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a503-f048-4ac8-8511-c852e6df34dc admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.824992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5a503-f048-4ac8-8511-c852e6df34dc admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:20.826774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5a503-f048-4ac8-8511-c852e6df34dc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:20.839762 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-8df5a503-f048-4ac8-8511-c852e6df34dc admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:25:20.841246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 430/837] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:20 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:20.848525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b50b1-8eec-4b8f-8175-f9ac895f1497 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:20.858601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b50b1-8eec-4b8f-8175-f9ac895f1497 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:20.864316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de75c02-feae-4544-a2e0-05e23dbfcaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:20.865474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de75c02-feae-4544-a2e0-05e23dbfcaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.865965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de75c02-feae-4544-a2e0-05e23dbfcaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.866995 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de75c02-feae-4544-a2e0-05e23dbfcaa1 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.867973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de75c02-feae-4544-a2e0-05e23dbfcaa1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:20.868568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de75c02-feae-4544-a2e0-05e23dbfcaa1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:20.870478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de75c02-feae-4544-a2e0-05e23dbfcaa1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:20.876762 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 408/838] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 04:25:20 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:20.884307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a503-f048-4ac8-8511-c852e6df34dc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:20.896163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a503-f048-4ac8-8511-c852e6df34dc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:20.901547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d7a9d-75b6-4715-ad8f-6f9da77eaeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:20.902584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7a9d-75b6-4715-ad8f-6f9da77eaeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.903059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7a9d-75b6-4715-ad8f-6f9da77eaeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.903610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7a9d-75b6-4715-ad8f-6f9da77eaeb2 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.904577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d7a9d-75b6-4715-ad8f-6f9da77eaeb2 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:20.905130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d7a9d-75b6-4715-ad8f-6f9da77eaeb2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:20.907014 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d7a9d-75b6-4715-ad8f-6f9da77eaeb2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:20.913587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 431/839] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 04:25:20 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:20.920676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de75c02-feae-4544-a2e0-05e23dbfcaa1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:20.933190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de75c02-feae-4544-a2e0-05e23dbfcaa1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:20.938952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9226bf-32a7-48a5-a601-7d094d29292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:20.939619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9226bf-32a7-48a5-a601-7d094d29292f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.939902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9226bf-32a7-48a5-a601-7d094d29292f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.940177 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9226bf-32a7-48a5-a601-7d094d29292f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.941022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9226bf-32a7-48a5-a601-7d094d29292f admin admin] RBAC: Adding query filter params (interface=public, service_id=7b282e0f105546a1aa7ebce1e098991a, region_id=RegionOne) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:20.941358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9226bf-32a7-48a5-a601-7d094d29292f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:20.942967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9226bf-32a7-48a5-a601-7d094d29292f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:20.949810 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 409/840] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 04:25:20 2021] GET /identity/v3/endpoints?service_id=7b282e0f105546a1aa7ebce1e098991a&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:20.956963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d7a9d-75b6-4715-ad8f-6f9da77eaeb2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:20.967423 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d7a9d-75b6-4715-ad8f-6f9da77eaeb2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:20.971951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f903e1c-5aa4-424c-b500-dcbcbde811a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:20.972679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903e1c-5aa4-424c-b500-dcbcbde811a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:20.972961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903e1c-5aa4-424c-b500-dcbcbde811a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:20.973236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903e1c-5aa4-424c-b500-dcbcbde811a9 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:20.974076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f903e1c-5aa4-424c-b500-dcbcbde811a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:20.975686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f903e1c-5aa4-424c-b500-dcbcbde811a9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:20.982375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 432/841] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:25:20 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:25:21.467256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596c43-522d-4ad4-aa6d-d6d01af1f235 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.467811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596c43-522d-4ad4-aa6d-d6d01af1f235 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.467811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596c43-522d-4ad4-aa6d-d6d01af1f235 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.469837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 410/842] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:21.475965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c950-db45-48ac-9786-e14683437c8d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.476411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c950-db45-48ac-9786-e14683437c8d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.476605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c950-db45-48ac-9786-e14683437c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.494565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-7bb8c950-db45-48ac-9786-e14683437c8d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:21.495765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7bb8c950-db45-48ac-9786-e14683437c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:21.503847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 433/843] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:21 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:21.529513 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596c43-522d-4ad4-aa6d-d6d01af1f235 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.543250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596c43-522d-4ad4-aa6d-d6d01af1f235 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.547892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c110a61-9114-4b8c-a33b-03b75c2342a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.548847 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c110a61-9114-4b8c-a33b-03b75c2342a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.554413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c110a61-9114-4b8c-a33b-03b75c2342a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.554413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c110a61-9114-4b8c-a33b-03b75c2342a4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.561123 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c110a61-9114-4b8c-a33b-03b75c2342a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:21.568778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-3c110a61-9114-4b8c-a33b-03b75c2342a4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:25:21.570916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 411/844] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:21.577778 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8c950-db45-48ac-9786-e14683437c8d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.587170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8c950-db45-48ac-9786-e14683437c8d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.591964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5cc8b-d9bb-40dd-8558-c6131d98a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.592834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5cc8b-d9bb-40dd-8558-c6131d98a11d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.593262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5cc8b-d9bb-40dd-8558-c6131d98a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.593722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5cc8b-d9bb-40dd-8558-c6131d98a11d admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.594613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5cc8b-d9bb-40dd-8558-c6131d98a11d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:21.595083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5cc8b-d9bb-40dd-8558-c6131d98a11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:21.596841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5cc8b-d9bb-40dd-8558-c6131d98a11d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:21.606211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 434/845] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:21.612729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c110a61-9114-4b8c-a33b-03b75c2342a4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.624529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c110a61-9114-4b8c-a33b-03b75c2342a4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.629553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efdcea-9ec8-48b0-ad32-8a2cee0e593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.630534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efdcea-9ec8-48b0-ad32-8a2cee0e593a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.630976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efdcea-9ec8-48b0-ad32-8a2cee0e593a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.631453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efdcea-9ec8-48b0-ad32-8a2cee0e593a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.644038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efdcea-9ec8-48b0-ad32-8a2cee0e593a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:21.646222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efdcea-9ec8-48b0-ad32-8a2cee0e593a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:21.664051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c9efdcea-9ec8-48b0-ad32-8a2cee0e593a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:21.665830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 412/846] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:21.672918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5cc8b-d9bb-40dd-8558-c6131d98a11d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.683897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5cc8b-d9bb-40dd-8558-c6131d98a11d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.689020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc444d5f-0a36-419e-bb8b-9afea1e7f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.689914 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444d5f-0a36-419e-bb8b-9afea1e7f050 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.690360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444d5f-0a36-419e-bb8b-9afea1e7f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.690807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444d5f-0a36-419e-bb8b-9afea1e7f050 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.691766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc444d5f-0a36-419e-bb8b-9afea1e7f050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:21.692247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc444d5f-0a36-419e-bb8b-9afea1e7f050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:21.694071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc444d5f-0a36-419e-bb8b-9afea1e7f050 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:21.707970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 435/847] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:21.714245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efdcea-9ec8-48b0-ad32-8a2cee0e593a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.724579 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efdcea-9ec8-48b0-ad32-8a2cee0e593a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.729301 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11511-5785-45e1-bf77-f722a1e30cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.730162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11511-5785-45e1-bf77-f722a1e30cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.730442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11511-5785-45e1-bf77-f722a1e30cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.730718 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11511-5785-45e1-bf77-f722a1e30cd9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.738645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11511-5785-45e1-bf77-f722a1e30cd9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:21.740771 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11511-5785-45e1-bf77-f722a1e30cd9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:21.756271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-23a11511-5785-45e1-bf77-f722a1e30cd9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:25:21.758382 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 413/848] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:21.765033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc444d5f-0a36-419e-bb8b-9afea1e7f050 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.775682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc444d5f-0a36-419e-bb8b-9afea1e7f050 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.780913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a2454-6faf-4090-af38-684d250623f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.781667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a2454-6faf-4090-af38-684d250623f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.781950 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a2454-6faf-4090-af38-684d250623f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.782286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a2454-6faf-4090-af38-684d250623f4 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.783165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a2454-6faf-4090-af38-684d250623f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:21.783526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a2454-6faf-4090-af38-684d250623f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:21.785556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a2454-6faf-4090-af38-684d250623f4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:21.807256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 436/849] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:21.813740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11511-5785-45e1-bf77-f722a1e30cd9 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.823911 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11511-5785-45e1-bf77-f722a1e30cd9 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.828858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ec995-7e9d-42b9-89ce-3a2b2de55d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.829786 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec995-7e9d-42b9-89ce-3a2b2de55d60 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.830241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec995-7e9d-42b9-89ce-3a2b2de55d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.830719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec995-7e9d-42b9-89ce-3a2b2de55d60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.839721 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ec995-7e9d-42b9-89ce-3a2b2de55d60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:21.841822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ec995-7e9d-42b9-89ce-3a2b2de55d60 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:21.852181 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 414/850] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/auth/tokens => generated 2291 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:21.858748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97fb89-9321-4391-bc65-46adf376f88f None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.859047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97fb89-9321-4391-bc65-46adf376f88f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.859331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97fb89-9321-4391-bc65-46adf376f88f None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.861331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ec995-7e9d-42b9-89ce-3a2b2de55d60 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.861441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 437/851] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:21.867835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6651a-d807-4688-a9bd-c699c98a4071 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.868127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6651a-d807-4688-a9bd-c699c98a4071 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.868438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6651a-d807-4688-a9bd-c699c98a4071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.871848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ec995-7e9d-42b9-89ce-3a2b2de55d60 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.876964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a0995-5883-468e-939e-468f8a6d6f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.878007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a0995-5883-468e-939e-468f8a6d6f46 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.878525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a0995-5883-468e-939e-468f8a6d6f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.879023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a0995-5883-468e-939e-468f8a6d6f46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.886392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d1e6651a-d807-4688-a9bd-c699c98a4071 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:21.887582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d1e6651a-d807-4688-a9bd-c699c98a4071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:21.890401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a0995-5883-468e-939e-468f8a6d6f46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:21.892856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a0995-5883-468e-939e-468f8a6d6f46 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:21.900439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 438/852] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:21 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:21.915381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-e97a0995-5883-468e-939e-468f8a6d6f46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:21.917084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 415/853] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:21.923069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6651a-d807-4688-a9bd-c699c98a4071 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.923821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a0995-5883-468e-939e-468f8a6d6f46 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.934520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6651a-d807-4688-a9bd-c699c98a4071 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.935860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a0995-5883-468e-939e-468f8a6d6f46 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.939758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21750d6-f5dc-4132-869e-8adcf1707921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.940781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21750d6-f5dc-4132-869e-8adcf1707921 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.941174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21750d6-f5dc-4132-869e-8adcf1707921 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.941465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2128af7-5883-4b15-83c6-45835df57298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.941627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21750d6-f5dc-4132-869e-8adcf1707921 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.942396 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128af7-5883-4b15-83c6-45835df57298 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.942558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21750d6-f5dc-4132-869e-8adcf1707921 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:21.942963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128af7-5883-4b15-83c6-45835df57298 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.943374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128af7-5883-4b15-83c6-45835df57298 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.944236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2128af7-5883-4b15-83c6-45835df57298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:21.944630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21750d6-f5dc-4132-869e-8adcf1707921 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:21.944910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2128af7-5883-4b15-83c6-45835df57298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:21.947090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2128af7-5883-4b15-83c6-45835df57298 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:21.958826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-d21750d6-f5dc-4132-869e-8adcf1707921 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:25:21.960265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 416/854] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:21.965628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 439/855] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/services/compute => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:21.967049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2128af7-5883-4b15-83c6-45835df57298 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.967504 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21750d6-f5dc-4132-869e-8adcf1707921 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:21.978996 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2128af7-5883-4b15-83c6-45835df57298 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.979388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21750d6-f5dc-4132-869e-8adcf1707921 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:21.984304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef9f01-9010-4fc0-8969-c5b541f811e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.984494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657650ae-f824-4c2b-ab13-99c948892626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:21.985285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657650ae-f824-4c2b-ab13-99c948892626 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.985593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef9f01-9010-4fc0-8969-c5b541f811e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:21.985764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657650ae-f824-4c2b-ab13-99c948892626 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.986144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657650ae-f824-4c2b-ab13-99c948892626 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.986293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef9f01-9010-4fc0-8969-c5b541f811e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:21.986710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef9f01-9010-4fc0-8969-c5b541f811e5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:21.987178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657650ae-f824-4c2b-ab13-99c948892626 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:21.987583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657650ae-f824-4c2b-ab13-99c948892626 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:21.989652 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657650ae-f824-4c2b-ab13-99c948892626 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:22.002410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 440/856] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:22.003663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657650ae-f824-4c2b-ab13-99c948892626 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:22.004081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef9f01-9010-4fc0-8969-c5b541f811e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:22.006291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef9f01-9010-4fc0-8969-c5b541f811e5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:22.014541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657650ae-f824-4c2b-ab13-99c948892626 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:22.020012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0021a-1fcb-40cc-a9e2-782aa7e21ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:22.020860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0021a-1fcb-40cc-a9e2-782aa7e21ccf admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:22.021251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0021a-1fcb-40cc-a9e2-782aa7e21ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:22.021634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0021a-1fcb-40cc-a9e2-782aa7e21ccf admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:22.022485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0021a-1fcb-40cc-a9e2-782aa7e21ccf admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:22.022923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0021a-1fcb-40cc-a9e2-782aa7e21ccf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:22.024497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-90ef9f01-9010-4fc0-8969-c5b541f811e5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:22.024817 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0021a-1fcb-40cc-a9e2-782aa7e21ccf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:22.031735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 417/858] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:22.032996 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef9f01-9010-4fc0-8969-c5b541f811e5 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:22.036640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 441/858] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:22 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:22.045218 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef9f01-9010-4fc0-8969-c5b541f811e5 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:22.050663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ff4c5-4a43-4de3-b47c-ff512a2ca8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:22.051666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ff4c5-4a43-4de3-b47c-ff512a2ca8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:22.052117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ff4c5-4a43-4de3-b47c-ff512a2ca8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:22.052626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ff4c5-4a43-4de3-b47c-ff512a2ca8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:22.053663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ff4c5-4a43-4de3-b47c-ff512a2ca8f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:22.054693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ff4c5-4a43-4de3-b47c-ff512a2ca8f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:22.057006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ff4c5-4a43-4de3-b47c-ff512a2ca8f0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:22.071185 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 418/859] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:22.078359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0021a-1fcb-40cc-a9e2-782aa7e21ccf admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:22.089196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0021a-1fcb-40cc-a9e2-782aa7e21ccf admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:22.094637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bb567-3899-4b44-bb3d-57f212db6dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:22.095623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bb567-3899-4b44-bb3d-57f212db6dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:22.096103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bb567-3899-4b44-bb3d-57f212db6dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:22.096666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bb567-3899-4b44-bb3d-57f212db6dd8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:22.097722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bb567-3899-4b44-bb3d-57f212db6dd8 admin admin] RBAC: Adding query filter params (role.id=a32916cfae1a48aa8c0f718bc14b2cb4, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=36d3a6eb24b04e14a42d771c9c768ed2) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:22.098229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bb567-3899-4b44-bb3d-57f212db6dd8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:22.100568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bb567-3899-4b44-bb3d-57f212db6dd8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:22.108935 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 442/860] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:22 2021] GET /identity/v3/role_assignments?user.id=36d3a6eb24b04e14a42d771c9c768ed2&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=a32916cfae1a48aa8c0f718bc14b2cb4 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:23.060030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c36bd0-f05a-4c79-849d-7b69841b8a01 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.060550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c36bd0-f05a-4c79-849d-7b69841b8a01 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.060550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c36bd0-f05a-4c79-849d-7b69841b8a01 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.062837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 419/861] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:23.069050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf55b7-b290-4738-8175-49458a07f809 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.070022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf55b7-b290-4738-8175-49458a07f809 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.070223 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf55b7-b290-4738-8175-49458a07f809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.087861 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-2bdf55b7-b290-4738-8175-49458a07f809 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:23.089077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-2bdf55b7-b290-4738-8175-49458a07f809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:23.097439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 443/862] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:23 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:23.121704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c36bd0-f05a-4c79-849d-7b69841b8a01 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:23.134542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c36bd0-f05a-4c79-849d-7b69841b8a01 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:23.139150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a578512-32dd-4282-99a0-7b0dc6a05a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:23.139821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578512-32dd-4282-99a0-7b0dc6a05a36 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.140098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578512-32dd-4282-99a0-7b0dc6a05a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.140399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578512-32dd-4282-99a0-7b0dc6a05a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.141126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578512-32dd-4282-99a0-7b0dc6a05a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:23.143009 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578512-32dd-4282-99a0-7b0dc6a05a36 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:23.144417 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.common [None req-1a578512-32dd-4282-99a0-7b0dc6a05a36 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 04:25:23.201600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.sql.core [None req-1a578512-32dd-4282-99a0-7b0dc6a05a36 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 04:25:23.201600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 04:25:23.201600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [parameters: {'id': '3b99116b1a1d4e91a40f55bba01dbb98', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 04:25:23.201600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73668) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 04:25:23.208285 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-1a578512-32dd-4282-99a0-7b0dc6a05a36 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3b99116b1a1d4e91a40f55bba01dbb98.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3b99116b1a1d4e91a40f55bba01dbb98. Aug 27 04:25:23.210957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 420/863] 10.222.0.25 () {60 vars in 1162 bytes} [Fri Aug 27 04:25:23 2021] POST /identity/v3/projects => generated 262 bytes in 90 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:23.217880 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf55b7-b290-4738-8175-49458a07f809 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:23.227860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf55b7-b290-4738-8175-49458a07f809 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:23.232724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cb596-77fc-44db-a50b-39324e62c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:23.233541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cb596-77fc-44db-a50b-39324e62c84d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.234048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cb596-77fc-44db-a50b-39324e62c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.234323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cb596-77fc-44db-a50b-39324e62c84d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.243123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cb596-77fc-44db-a50b-39324e62c84d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:23.243488 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255c1b-0f78-48fd-b1ff-060eda476d65 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.243772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255c1b-0f78-48fd-b1ff-060eda476d65 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.244094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255c1b-0f78-48fd-b1ff-060eda476d65 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.245249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cb596-77fc-44db-a50b-39324e62c84d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:23.249653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 421/864] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:23 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:23.256154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703ff6-b7d5-432b-8276-b254545a9963 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.256590 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703ff6-b7d5-432b-8276-b254545a9963 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.256896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703ff6-b7d5-432b-8276-b254545a9963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.265869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-de4cb596-77fc-44db-a50b-39324e62c84d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:23.267605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 444/865] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:23.275775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cb596-77fc-44db-a50b-39324e62c84d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:23.279031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-71703ff6-b7d5-432b-8276-b254545a9963 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:23.281072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-71703ff6-b7d5-432b-8276-b254545a9963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:23.287885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cb596-77fc-44db-a50b-39324e62c84d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:23.292077 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 422/866] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:23 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:23.294540 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a982c20-fa9c-44db-acb2-e1fa069ac6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:23.295207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a982c20-fa9c-44db-acb2-e1fa069ac6cc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.295486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a982c20-fa9c-44db-acb2-e1fa069ac6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.295785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a982c20-fa9c-44db-acb2-e1fa069ac6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.296675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a982c20-fa9c-44db-acb2-e1fa069ac6cc admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:23.296979 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a982c20-fa9c-44db-acb2-e1fa069ac6cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:23.298804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a982c20-fa9c-44db-acb2-e1fa069ac6cc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:23.318512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71703ff6-b7d5-432b-8276-b254545a9963 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:23.328096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71703ff6-b7d5-432b-8276-b254545a9963 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:23.328840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 445/867] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:23 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:23.333245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136627-c36d-4564-b468-84da84bb578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:23.334081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136627-c36d-4564-b468-84da84bb578c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.334358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136627-c36d-4564-b468-84da84bb578c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.334628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136627-c36d-4564-b468-84da84bb578c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.335345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5136627-c36d-4564-b468-84da84bb578c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:23.337508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5136627-c36d-4564-b468-84da84bb578c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:23.350394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-a5136627-c36d-4564-b468-84da84bb578c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:25:23.352761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 423/868] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:23 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:23.360078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a982c20-fa9c-44db-acb2-e1fa069ac6cc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:23.371839 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a982c20-fa9c-44db-acb2-e1fa069ac6cc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:23.377032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44463118-cd7b-42f6-8fe2-252c33cba270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:23.377856 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44463118-cd7b-42f6-8fe2-252c33cba270 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.378190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44463118-cd7b-42f6-8fe2-252c33cba270 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.378473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44463118-cd7b-42f6-8fe2-252c33cba270 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.379340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44463118-cd7b-42f6-8fe2-252c33cba270 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:23.379671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44463118-cd7b-42f6-8fe2-252c33cba270 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:23.381491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44463118-cd7b-42f6-8fe2-252c33cba270 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:23.392552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 446/869] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 04:25:23 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:23.395915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136627-c36d-4564-b468-84da84bb578c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:23.407240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136627-c36d-4564-b468-84da84bb578c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:23.412449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3a78d-b7a8-4485-a834-38c53c1921a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:23.413706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3a78d-b7a8-4485-a834-38c53c1921a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.414025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3a78d-b7a8-4485-a834-38c53c1921a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.414369 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3a78d-b7a8-4485-a834-38c53c1921a7 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.415167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3a78d-b7a8-4485-a834-38c53c1921a7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:23.415529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3a78d-b7a8-4485-a834-38c53c1921a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:23.417956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3a78d-b7a8-4485-a834-38c53c1921a7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:23.428521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 424/870] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 04:25:23 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:23.432326 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44463118-cd7b-42f6-8fe2-252c33cba270 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:23.443563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44463118-cd7b-42f6-8fe2-252c33cba270 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:23.448822 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34efd60-4e72-45b1-a9f6-cd8c9e23c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:23.449615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34efd60-4e72-45b1-a9f6-cd8c9e23c7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:23.449958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34efd60-4e72-45b1-a9f6-cd8c9e23c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:23.450334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34efd60-4e72-45b1-a9f6-cd8c9e23c7d9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:23.451266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34efd60-4e72-45b1-a9f6-cd8c9e23c7d9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:23.453148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34efd60-4e72-45b1-a9f6-cd8c9e23c7d9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:23.551143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 447/871] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 04:25:23 2021] POST /identity/v3/endpoints => generated 349 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:24.291974 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9a05d-203e-417a-9326-a4f44fa0d25e None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:24.293211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9a05d-203e-417a-9326-a4f44fa0d25e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:24.293211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9a05d-203e-417a-9326-a4f44fa0d25e None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:24.295403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 425/872] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:24.302610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd708b9-c498-4ac3-a3e4-90c263b7f083 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:24.303252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd708b9-c498-4ac3-a3e4-90c263b7f083 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:24.303252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd708b9-c498-4ac3-a3e4-90c263b7f083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:24.323358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-fcd708b9-c498-4ac3-a3e4-90c263b7f083 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:24.324601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-fcd708b9-c498-4ac3-a3e4-90c263b7f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:24.342703 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 448/873] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:24 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:24.368919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9a05d-203e-417a-9326-a4f44fa0d25e None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:24.372064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4780ed-d5a9-4611-82c1-fe3db3f49152 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:24.372377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4780ed-d5a9-4611-82c1-fe3db3f49152 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:24.372665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4780ed-d5a9-4611-82c1-fe3db3f49152 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:24.374736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 449/874] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:24.380694 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150dcf4-43cc-4fc7-8db6-8eefe65d7921 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:24.380975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150dcf4-43cc-4fc7-8db6-8eefe65d7921 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:24.381253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150dcf4-43cc-4fc7-8db6-8eefe65d7921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:24.383646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9a05d-203e-417a-9326-a4f44fa0d25e None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:24.388619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bbb9c-2697-4569-8124-ee0b4489ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:24.389316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bbb9c-2697-4569-8124-ee0b4489ec96 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:24.389621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bbb9c-2697-4569-8124-ee0b4489ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:24.389927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bbb9c-2697-4569-8124-ee0b4489ec96 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:24.390729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bbb9c-2697-4569-8124-ee0b4489ec96 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:24.392576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bbb9c-2697-4569-8124-ee0b4489ec96 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:24.399642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d150dcf4-43cc-4fc7-8db6-8eefe65d7921 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:24.400893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d150dcf4-43cc-4fc7-8db6-8eefe65d7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:24.408824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 450/875] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:24 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:24.436692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150dcf4-43cc-4fc7-8db6-8eefe65d7921 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:24.446041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150dcf4-43cc-4fc7-8db6-8eefe65d7921 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:24.451225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1881dbb-6f14-43ca-9f56-9838cd3286ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:24.452036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1881dbb-6f14-43ca-9f56-9838cd3286ae admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:24.452318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1881dbb-6f14-43ca-9f56-9838cd3286ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:24.452625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1881dbb-6f14-43ca-9f56-9838cd3286ae admin admin] PATH_INFO: `/v3/services/image` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:24.453299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1881dbb-6f14-43ca-9f56-9838cd3286ae admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:24.454931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1881dbb-6f14-43ca-9f56-9838cd3286ae admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:24.466886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-e1881dbb-6f14-43ca-9f56-9838cd3286ae admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:25:24.468130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 451/876] 10.222.0.25 () {56 vars in 1127 bytes} [Fri Aug 27 04:25:24 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:24.474665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1881dbb-6f14-43ca-9f56-9838cd3286ae admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:24.485142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1881dbb-6f14-43ca-9f56-9838cd3286ae admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:24.489761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccbc0-f017-4432-918b-b0761890312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:24.490429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccbc0-f017-4432-918b-b0761890312c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:24.490715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccbc0-f017-4432-918b-b0761890312c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:24.490991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccbc0-f017-4432-918b-b0761890312c admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:24.491727 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ccbc0-f017-4432-918b-b0761890312c admin admin] RBAC: Adding query filter params (name=image) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:24.492036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ccbc0-f017-4432-918b-b0761890312c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:24.493695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ccbc0-f017-4432-918b-b0761890312c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:24.498836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 452/877] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:24 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:24.505330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccbc0-f017-4432-918b-b0761890312c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:24.516596 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccbc0-f017-4432-918b-b0761890312c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:24.525596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 426/878] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:25:24 2021] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:24.539827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a1ec1-8d60-4a10-be46-1eba5e74ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:24.540999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a1ec1-8d60-4a10-be46-1eba5e74ebbe admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:24.541490 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a1ec1-8d60-4a10-be46-1eba5e74ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:24.541944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a1ec1-8d60-4a10-be46-1eba5e74ebbe admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:24.543324 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a1ec1-8d60-4a10-be46-1eba5e74ebbe admin admin] RBAC: Adding query filter params (type=image) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:24.543849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a1ec1-8d60-4a10-be46-1eba5e74ebbe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:24.545825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a1ec1-8d60-4a10-be46-1eba5e74ebbe admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:24.556572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 453/879] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:24 2021] GET /identity/v3/services?type=image => generated 122 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:25.606992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d30a5-5f69-478e-83d1-8b1ee461f94c None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:25.607514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d30a5-5f69-478e-83d1-8b1ee461f94c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:25.607514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d30a5-5f69-478e-83d1-8b1ee461f94c None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:25.609651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 427/880] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:25.617304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3398-0874-409a-81b3-44908902a55d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:25.617800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3398-0874-409a-81b3-44908902a55d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:25.617872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3398-0874-409a-81b3-44908902a55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:25.640531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-1bab3398-0874-409a-81b3-44908902a55d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:25.641756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1bab3398-0874-409a-81b3-44908902a55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:25.649975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 454/881] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:25 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:25.676441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d30a5-5f69-478e-83d1-8b1ee461f94c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:25.693066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d30a5-5f69-478e-83d1-8b1ee461f94c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:25.699646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3b743-8df4-4f4e-8fd0-bb5a7e0e3061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:25.700319 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b743-8df4-4f4e-8fd0-bb5a7e0e3061 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:25.700636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b743-8df4-4f4e-8fd0-bb5a7e0e3061 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:25.700908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b743-8df4-4f4e-8fd0-bb5a7e0e3061 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:25.701618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3b743-8df4-4f4e-8fd0-bb5a7e0e3061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:25.703584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3b743-8df4-4f4e-8fd0-bb5a7e0e3061 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:25.773053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.sql.core [None req-1ee3b743-8df4-4f4e-8fd0-bb5a7e0e3061 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 04:25:25.773053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 27 04:25:25.773053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [parameters: {'user_id': '31874140343d440ea4722453accdc719', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 27 04:25:25.773053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73668) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 04:25:25.781001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-1ee3b743-8df4-4f4e-8fd0-bb5a7e0e3061 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 27 04:25:25.782652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 428/882] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:25:25 2021] POST /identity/v3/users => generated 160 bytes in 107 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:25.790097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3398-0874-409a-81b3-44908902a55d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:25.800214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3398-0874-409a-81b3-44908902a55d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:25.806055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fec8fe-b258-4aa8-931a-e8ccb823d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:25.807207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fec8fe-b258-4aa8-931a-e8ccb823d68c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:25.807688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fec8fe-b258-4aa8-931a-e8ccb823d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:25.808160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fec8fe-b258-4aa8-931a-e8ccb823d68c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:25.816513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fec8fe-b258-4aa8-931a-e8ccb823d68c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:25.818985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fec8fe-b258-4aa8-931a-e8ccb823d68c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:25.827806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884bb1c-9592-492b-9a33-f354a1f03506 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:25.828099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884bb1c-9592-492b-9a33-f354a1f03506 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:25.828379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884bb1c-9592-492b-9a33-f354a1f03506 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:25.833457 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 429/883] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:25 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:25.836225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-45fec8fe-b258-4aa8-931a-e8ccb823d68c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:25:25.838693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 455/884] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:25 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:25.843819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072693-e3f1-4aa7-a4b2-899e103b9bee None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:25.843819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072693-e3f1-4aa7-a4b2-899e103b9bee None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:25.843819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072693-e3f1-4aa7-a4b2-899e103b9bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:25.845056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fec8fe-b258-4aa8-931a-e8ccb823d68c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:25.858416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fec8fe-b258-4aa8-931a-e8ccb823d68c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:25.863066 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05984e50-83be-4494-9fd8-4ac30a167554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:25.863739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05984e50-83be-4494-9fd8-4ac30a167554 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:25.864029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05984e50-83be-4494-9fd8-4ac30a167554 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:25.864298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05984e50-83be-4494-9fd8-4ac30a167554 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:25.865135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05984e50-83be-4494-9fd8-4ac30a167554 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:25.865441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05984e50-83be-4494-9fd8-4ac30a167554 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:25.867835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05984e50-83be-4494-9fd8-4ac30a167554 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:25.870331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0f072693-e3f1-4aa7-a4b2-899e103b9bee None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:25.872112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0f072693-e3f1-4aa7-a4b2-899e103b9bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:25.880959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 430/885] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:25 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:25.903416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 456/886] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 04:25:25 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:25.904422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072693-e3f1-4aa7-a4b2-899e103b9bee None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:25.915015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072693-e3f1-4aa7-a4b2-899e103b9bee None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:25.920798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774ea97-b5a6-4d2e-ab75-6e138681bc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:25.922017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774ea97-b5a6-4d2e-ab75-6e138681bc34 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:25.922503 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774ea97-b5a6-4d2e-ab75-6e138681bc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:25.922996 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774ea97-b5a6-4d2e-ab75-6e138681bc34 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:25.923897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774ea97-b5a6-4d2e-ab75-6e138681bc34 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:25.926092 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774ea97-b5a6-4d2e-ab75-6e138681bc34 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:25.939759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-8774ea97-b5a6-4d2e-ab75-6e138681bc34 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:25:25.941778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 431/887] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:25 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:25.948639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05984e50-83be-4494-9fd8-4ac30a167554 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:25.961426 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05984e50-83be-4494-9fd8-4ac30a167554 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:25.966349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d7622-8a38-4128-8722-7e001e6bad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:25.967029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d7622-8a38-4128-8722-7e001e6bad83 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:25.967308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d7622-8a38-4128-8722-7e001e6bad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:25.967582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d7622-8a38-4128-8722-7e001e6bad83 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:25.968299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d7622-8a38-4128-8722-7e001e6bad83 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:25.968655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d7622-8a38-4128-8722-7e001e6bad83 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:25.970288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d7622-8a38-4128-8722-7e001e6bad83 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:25.980724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 457/888] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 04:25:25 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:25.983219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774ea97-b5a6-4d2e-ab75-6e138681bc34 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:25.993681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774ea97-b5a6-4d2e-ab75-6e138681bc34 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:25.998553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773750b-97e4-401e-afd4-7644d0131f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:25.999374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773750b-97e4-401e-afd4-7644d0131f14 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:25.999757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773750b-97e4-401e-afd4-7644d0131f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.000137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773750b-97e4-401e-afd4-7644d0131f14 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.001049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773750b-97e4-401e-afd4-7644d0131f14 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:26.001462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773750b-97e4-401e-afd4-7644d0131f14 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:26.003190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773750b-97e4-401e-afd4-7644d0131f14 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:26.009547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 432/889] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 04:25:25 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:26.016211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d7622-8a38-4128-8722-7e001e6bad83 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:26.027007 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d7622-8a38-4128-8722-7e001e6bad83 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:26.031992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a31f0-95cc-46b1-9292-4aa947476265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:26.032921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a31f0-95cc-46b1-9292-4aa947476265 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.033346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a31f0-95cc-46b1-9292-4aa947476265 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.033763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a31f0-95cc-46b1-9292-4aa947476265 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.034701 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a31f0-95cc-46b1-9292-4aa947476265 admin admin] RBAC: Adding query filter params (interface=admin, service_id=7b282e0f105546a1aa7ebce1e098991a, region_id=RegionOne) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:26.035170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a31f0-95cc-46b1-9292-4aa947476265 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:26.036965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a31f0-95cc-46b1-9292-4aa947476265 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:26.044394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 458/890] 10.222.0.25 () {56 vars in 1271 bytes} [Fri Aug 27 04:25:26 2021] GET /identity/v3/endpoints?service_id=7b282e0f105546a1aa7ebce1e098991a&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:26.051249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773750b-97e4-401e-afd4-7644d0131f14 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:26.061790 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773750b-97e4-401e-afd4-7644d0131f14 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:26.066852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed668488-5b75-46a8-8bfc-856e51e08cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:26.067808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed668488-5b75-46a8-8bfc-856e51e08cdc admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.068231 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed668488-5b75-46a8-8bfc-856e51e08cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.068670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed668488-5b75-46a8-8bfc-856e51e08cdc admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.069570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed668488-5b75-46a8-8bfc-856e51e08cdc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:26.071392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed668488-5b75-46a8-8bfc-856e51e08cdc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:26.079111 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 433/891] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:25:26 2021] GET /identity/v3/services => generated 1727 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:25:26.765978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbd78-07a0-46be-9b48-072729b05e27 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.766515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbd78-07a0-46be-9b48-072729b05e27 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.766515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbd78-07a0-46be-9b48-072729b05e27 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.768784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 459/892] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:26.775300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb90a-ad31-4b72-8167-a30e4334d7db None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.776042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb90a-ad31-4b72-8167-a30e4334d7db None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.776042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb90a-ad31-4b72-8167-a30e4334d7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.795820 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-940bb90a-ad31-4b72-8167-a30e4334d7db None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:26.797069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-940bb90a-ad31-4b72-8167-a30e4334d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:26.805699 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 434/893] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:26 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:26.829692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cbd78-07a0-46be-9b48-072729b05e27 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:26.842193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cbd78-07a0-46be-9b48-072729b05e27 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:26.846190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54a58-5b4b-45e9-ae19-1a452bd9ed3d None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.846482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54a58-5b4b-45e9-ae19-1a452bd9ed3d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.846646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e234-45bc-48b2-8f9a-ad3b1582ebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:26.846757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54a58-5b4b-45e9-ae19-1a452bd9ed3d None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.847431 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e234-45bc-48b2-8f9a-ad3b1582ebfe admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.847720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e234-45bc-48b2-8f9a-ad3b1582ebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.848001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e234-45bc-48b2-8f9a-ad3b1582ebfe admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.848673 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 435/894] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:26.848773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44e234-45bc-48b2-8f9a-ad3b1582ebfe admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:26.850276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44e234-45bc-48b2-8f9a-ad3b1582ebfe admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:26.854166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd70c-8aba-4bc5-af5f-733e963b80e0 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.854447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd70c-8aba-4bc5-af5f-733e963b80e0 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.854726 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd70c-8aba-4bc5-af5f-733e963b80e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.861696 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-ea44e234-45bc-48b2-8f9a-ad3b1582ebfe admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:25:26.863025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 460/895] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:26 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:26.869872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e234-45bc-48b2-8f9a-ad3b1582ebfe admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:26.873290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c97fd70c-8aba-4bc5-af5f-733e963b80e0 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:26.874515 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c97fd70c-8aba-4bc5-af5f-733e963b80e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:26.879414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e234-45bc-48b2-8f9a-ad3b1582ebfe admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:26.883238 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 436/896] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:26 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:26.884815 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b9a87-c5a3-4531-aef5-c2aa01984d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:26.885464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b9a87-c5a3-4531-aef5-c2aa01984d38 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.885748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b9a87-c5a3-4531-aef5-c2aa01984d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.886025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b9a87-c5a3-4531-aef5-c2aa01984d38 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.886730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b9a87-c5a3-4531-aef5-c2aa01984d38 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:26.887035 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b9a87-c5a3-4531-aef5-c2aa01984d38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:26.888638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b9a87-c5a3-4531-aef5-c2aa01984d38 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:26.893707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 461/897] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:26 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:26.900062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fd70c-8aba-4bc5-af5f-733e963b80e0 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:26.906849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b9a87-c5a3-4531-aef5-c2aa01984d38 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:26.909756 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fd70c-8aba-4bc5-af5f-733e963b80e0 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:26.914641 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e94c95-dbdb-433e-b108-996bc5622882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:26.915301 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e94c95-dbdb-433e-b108-996bc5622882 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.915585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e94c95-dbdb-433e-b108-996bc5622882 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.915866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e94c95-dbdb-433e-b108-996bc5622882 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.916341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b9a87-c5a3-4531-aef5-c2aa01984d38 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:26.916601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e94c95-dbdb-433e-b108-996bc5622882 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:26.916908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e94c95-dbdb-433e-b108-996bc5622882 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:26.918769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e94c95-dbdb-433e-b108-996bc5622882 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:26.921323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164051f-642b-49cc-bced-9862ce318bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:26.921987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164051f-642b-49cc-bced-9862ce318bba admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.922256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164051f-642b-49cc-bced-9862ce318bba admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.922530 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164051f-642b-49cc-bced-9862ce318bba admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.923243 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164051f-642b-49cc-bced-9862ce318bba admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:26.924066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 437/898] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:26 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:26.924992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164051f-642b-49cc-bced-9862ce318bba admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:26.930767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e94c95-dbdb-433e-b108-996bc5622882 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:26.940310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e94c95-dbdb-433e-b108-996bc5622882 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:26.945502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04759873-14ec-4031-a3e1-773f73fef251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:26.947968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04759873-14ec-4031-a3e1-773f73fef251 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.947968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04759873-14ec-4031-a3e1-773f73fef251 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.947968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04759873-14ec-4031-a3e1-773f73fef251 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.947968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04759873-14ec-4031-a3e1-773f73fef251 admin admin] RBAC: Adding query filter params (interface=public, service_id=c342fb2807624f219cba0dc361b1a1fb, region_id=RegionOne) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:26.947968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04759873-14ec-4031-a3e1-773f73fef251 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:26.949363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04759873-14ec-4031-a3e1-773f73fef251 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:26.954535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 438/899] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 04:25:26 2021] GET /identity/v3/endpoints?service_id=c342fb2807624f219cba0dc361b1a1fb&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:26.960799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04759873-14ec-4031-a3e1-773f73fef251 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:26.970579 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04759873-14ec-4031-a3e1-773f73fef251 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:26.975374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf46250-68f9-4d12-90f2-27397ec940c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:26.976133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf46250-68f9-4d12-90f2-27397ec940c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:26.976458 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf46250-68f9-4d12-90f2-27397ec940c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:26.982591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf46250-68f9-4d12-90f2-27397ec940c9 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:26.982591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf46250-68f9-4d12-90f2-27397ec940c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:26.982591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf46250-68f9-4d12-90f2-27397ec940c9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:26.986161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 439/900] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:25:26 2021] GET /identity/v3/services => generated 1727 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:25:27.018559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 462/901] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:25:26 2021] POST /identity/v3/services => generated 242 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:28.275405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e012d-f070-451e-a2b6-8448e8791a32 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:28.275929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e012d-f070-451e-a2b6-8448e8791a32 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:28.275929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e012d-f070-451e-a2b6-8448e8791a32 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:28.277932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 440/902] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:28.283797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fd6f3-61e9-4000-8f5f-b4f99c97ec72 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:28.284296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fd6f3-61e9-4000-8f5f-b4f99c97ec72 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:28.284574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fd6f3-61e9-4000-8f5f-b4f99c97ec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:28.302241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-bb4fd6f3-61e9-4000-8f5f-b4f99c97ec72 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:28.303441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-bb4fd6f3-61e9-4000-8f5f-b4f99c97ec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:28.320854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 463/903] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:28 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:28.344171 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e012d-f070-451e-a2b6-8448e8791a32 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:28.356155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e012d-f070-451e-a2b6-8448e8791a32 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:28.360521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305051e6-ec15-4430-b8e0-97d4dd22710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:28.361298 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305051e6-ec15-4430-b8e0-97d4dd22710c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:28.361576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305051e6-ec15-4430-b8e0-97d4dd22710c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:28.361843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305051e6-ec15-4430-b8e0-97d4dd22710c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:28.362480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305051e6-ec15-4430-b8e0-97d4dd22710c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:28.364064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305051e6-ec15-4430-b8e0-97d4dd22710c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:28.375392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-305051e6-ec15-4430-b8e0-97d4dd22710c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:25:28.382672 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 441/904] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 04:25:28 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:28.384152 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fd6f3-61e9-4000-8f5f-b4f99c97ec72 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:28.392960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fd6f3-61e9-4000-8f5f-b4f99c97ec72 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:28.398009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b281-7690-43af-9065-4ad5ea4458b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:28.398763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b281-7690-43af-9065-4ad5ea4458b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:28.399042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b281-7690-43af-9065-4ad5ea4458b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:28.399308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b281-7690-43af-9065-4ad5ea4458b2 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:28.400009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6b281-7690-43af-9065-4ad5ea4458b2 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:28.400304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6b281-7690-43af-9065-4ad5ea4458b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:28.401911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6b281-7690-43af-9065-4ad5ea4458b2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:28.406828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 464/905] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 04:25:28 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:28.412730 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305051e6-ec15-4430-b8e0-97d4dd22710c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:28.422876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305051e6-ec15-4430-b8e0-97d4dd22710c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:28.427325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0ac03-38f6-4cb3-a61f-df29db13abca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:28.427957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0ac03-38f6-4cb3-a61f-df29db13abca admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:28.428230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0ac03-38f6-4cb3-a61f-df29db13abca admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:28.428532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0ac03-38f6-4cb3-a61f-df29db13abca admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:28.429245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0ac03-38f6-4cb3-a61f-df29db13abca admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:28.429545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0ac03-38f6-4cb3-a61f-df29db13abca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:28.431109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0ac03-38f6-4cb3-a61f-df29db13abca admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:28.435973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 442/906] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 04:25:28 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:28.441811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b281-7690-43af-9065-4ad5ea4458b2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:28.451651 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b281-7690-43af-9065-4ad5ea4458b2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:28.456212 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb6bca-dfe0-4afd-917d-fdf6300aa95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:28.456980 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb6bca-dfe0-4afd-917d-fdf6300aa95f admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:28.457328 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb6bca-dfe0-4afd-917d-fdf6300aa95f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:28.457674 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb6bca-dfe0-4afd-917d-fdf6300aa95f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:28.458488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb6bca-dfe0-4afd-917d-fdf6300aa95f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:28.460697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb6bca-dfe0-4afd-917d-fdf6300aa95f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:28.567849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 465/907] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 04:25:28 2021] POST /identity/v3/endpoints => generated 325 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:25:29.197293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f3be-f907-4025-836c-d142de3161f3 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.197668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f3be-f907-4025-836c-d142de3161f3 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.197859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f3be-f907-4025-836c-d142de3161f3 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.199772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 443/908] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:29.205726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758134f-9ca1-4024-8051-63799ac53f9d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.206017 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758134f-9ca1-4024-8051-63799ac53f9d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.206294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758134f-9ca1-4024-8051-63799ac53f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.214789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d232fa-f6e9-4343-93b2-e412c4f9dc5a None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.215272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d232fa-f6e9-4343-93b2-e412c4f9dc5a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.215549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d232fa-f6e9-4343-93b2-e412c4f9dc5a None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.217459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 444/909] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:29.223193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6cd6-c689-4c8c-99fc-b731f782d4f6 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.223695 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6cd6-c689-4c8c-99fc-b731f782d4f6 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.224166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6cd6-c689-4c8c-99fc-b731f782d4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.224905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-7758134f-9ca1-4024-8051-63799ac53f9d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:29.226737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7758134f-9ca1-4024-8051-63799ac53f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:29.242737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-9efa6cd6-c689-4c8c-99fc-b731f782d4f6 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:29.243894 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9efa6cd6-c689-4c8c-99fc-b731f782d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:29.244538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 466/910] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:29 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:29.255485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 445/911] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:29 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:29.268667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758134f-9ca1-4024-8051-63799ac53f9d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:29.278629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758134f-9ca1-4024-8051-63799ac53f9d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:29.279592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6cd6-c689-4c8c-99fc-b731f782d4f6 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:29.283345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468551c0-d56b-4920-80d3-d1583eee992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:29.284138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468551c0-d56b-4920-80d3-d1583eee992b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.284655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468551c0-d56b-4920-80d3-d1583eee992b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.284737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468551c0-d56b-4920-80d3-d1583eee992b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.285389 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468551c0-d56b-4920-80d3-d1583eee992b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:29.286957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468551c0-d56b-4920-80d3-d1583eee992b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:29.289142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6cd6-c689-4c8c-99fc-b731f782d4f6 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:29.293974 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bf532-3bee-40e6-9edc-3a1b7a20a57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:29.294747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bf532-3bee-40e6-9edc-3a1b7a20a57c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.295025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bf532-3bee-40e6-9edc-3a1b7a20a57c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.295291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bf532-3bee-40e6-9edc-3a1b7a20a57c admin admin] PATH_INFO: `/v3/services/image` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.295941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bf532-3bee-40e6-9edc-3a1b7a20a57c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:29.297544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bf532-3bee-40e6-9edc-3a1b7a20a57c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:29.298734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-468551c0-d56b-4920-80d3-d1583eee992b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:25:29.300076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 467/912] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:29 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:29.306706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468551c0-d56b-4920-80d3-d1583eee992b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:29.308666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-000bf532-3bee-40e6-9edc-3a1b7a20a57c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:25:29.309950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 446/913] 10.222.0.25 () {56 vars in 1127 bytes} [Fri Aug 27 04:25:29 2021] GET /identity/v3/services/image => generated 86 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:29.316247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468551c0-d56b-4920-80d3-d1583eee992b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:29.316400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bf532-3bee-40e6-9edc-3a1b7a20a57c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:29.321294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba90c0-fbea-4886-8023-627691d5b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:29.321941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba90c0-fbea-4886-8023-627691d5b2dd admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.322220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba90c0-fbea-4886-8023-627691d5b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.322492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba90c0-fbea-4886-8023-627691d5b2dd admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.323189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba90c0-fbea-4886-8023-627691d5b2dd admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:29.323488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba90c0-fbea-4886-8023-627691d5b2dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:29.325098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba90c0-fbea-4886-8023-627691d5b2dd admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:29.326320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bf532-3bee-40e6-9edc-3a1b7a20a57c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:29.330588 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 468/914] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:29 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:29.336449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1da8b5-a5ee-4e50-8ace-6b7d09fb2452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:29.336449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1da8b5-a5ee-4e50-8ace-6b7d09fb2452 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.336449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1da8b5-a5ee-4e50-8ace-6b7d09fb2452 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.336449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1da8b5-a5ee-4e50-8ace-6b7d09fb2452 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.336808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1da8b5-a5ee-4e50-8ace-6b7d09fb2452 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:29.336808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1da8b5-a5ee-4e50-8ace-6b7d09fb2452 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:29.336808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1da8b5-a5ee-4e50-8ace-6b7d09fb2452 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:29.337705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba90c0-fbea-4886-8023-627691d5b2dd admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:29.341613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 447/915] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:29 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:29.347923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1da8b5-a5ee-4e50-8ace-6b7d09fb2452 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:29.348871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba90c0-fbea-4886-8023-627691d5b2dd admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:29.353791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59eb5a-d1ac-4c6c-801b-0b5c512e8f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:29.354444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59eb5a-d1ac-4c6c-801b-0b5c512e8f6f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.354729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59eb5a-d1ac-4c6c-801b-0b5c512e8f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.355006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59eb5a-d1ac-4c6c-801b-0b5c512e8f6f admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.355710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59eb5a-d1ac-4c6c-801b-0b5c512e8f6f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:29.356016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59eb5a-d1ac-4c6c-801b-0b5c512e8f6f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:29.357358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1da8b5-a5ee-4e50-8ace-6b7d09fb2452 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:29.357641 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59eb5a-d1ac-4c6c-801b-0b5c512e8f6f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:29.361988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa23a8-c1e3-4024-b4a2-ab14230a9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:29.362631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa23a8-c1e3-4024-b4a2-ab14230a9fce admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.362909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa23a8-c1e3-4024-b4a2-ab14230a9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.363179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa23a8-c1e3-4024-b4a2-ab14230a9fce admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.363966 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa23a8-c1e3-4024-b4a2-ab14230a9fce admin admin] RBAC: Adding query filter params (type=image) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:29.364270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa23a8-c1e3-4024-b4a2-ab14230a9fce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:29.365884 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa23a8-c1e3-4024-b4a2-ab14230a9fce admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:29.368593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 469/916] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 04:25:29 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:29.369499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59eb5a-d1ac-4c6c-801b-0b5c512e8f6f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:29.376285 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 448/917] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:29 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:29.378259 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa23a8-c1e3-4024-b4a2-ab14230a9fce admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:29.379738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59eb5a-d1ac-4c6c-801b-0b5c512e8f6f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:29.384803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dacf1d-acca-4119-ba16-def73737a209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:29.385462 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dacf1d-acca-4119-ba16-def73737a209 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.385745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dacf1d-acca-4119-ba16-def73737a209 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.386021 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dacf1d-acca-4119-ba16-def73737a209 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.386763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dacf1d-acca-4119-ba16-def73737a209 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:29.388342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dacf1d-acca-4119-ba16-def73737a209 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:29.389533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa23a8-c1e3-4024-b4a2-ab14230a9fce admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:29.394393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045680b-cb86-45da-964f-7f29f02b7907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:29.395030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045680b-cb86-45da-964f-7f29f02b7907 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.395312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045680b-cb86-45da-964f-7f29f02b7907 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.395743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045680b-cb86-45da-964f-7f29f02b7907 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.396564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045680b-cb86-45da-964f-7f29f02b7907 admin admin] RBAC: Adding query filter params (interface=public, service_id=a371cdac1f0f4c628707f3acc520baf1, region_id=RegionOne) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:29.396875 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045680b-cb86-45da-964f-7f29f02b7907 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:29.399089 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045680b-cb86-45da-964f-7f29f02b7907 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:29.404169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 449/918] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 04:25:29 2021] GET /identity/v3/endpoints?service_id=a371cdac1f0f4c628707f3acc520baf1&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:29.410290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045680b-cb86-45da-964f-7f29f02b7907 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:29.420003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045680b-cb86-45da-964f-7f29f02b7907 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:29.424752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141936-30fc-49b8-91c9-ad4fa032e5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:29.425441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141936-30fc-49b8-91c9-ad4fa032e5cf admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:29.425727 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141936-30fc-49b8-91c9-ad4fa032e5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:29.426007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141936-30fc-49b8-91c9-ad4fa032e5cf admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:29.426692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f141936-30fc-49b8-91c9-ad4fa032e5cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:29.428343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f141936-30fc-49b8-91c9-ad4fa032e5cf admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:29.435244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 450/919] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:25:29 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:25:29.477656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 470/920] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 04:25:29 2021] POST /identity/v3/endpoints => generated 334 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:30.778027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d826040-ea4b-4946-a0be-89727e7361d2 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:30.778536 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d826040-ea4b-4946-a0be-89727e7361d2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:30.778609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d826040-ea4b-4946-a0be-89727e7361d2 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:30.780339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 451/921] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:30.786620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751104a-3443-41e2-93e7-0360a66a9c19 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:30.787079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751104a-3443-41e2-93e7-0360a66a9c19 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:30.787156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751104a-3443-41e2-93e7-0360a66a9c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:30.806239 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-0751104a-3443-41e2-93e7-0360a66a9c19 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:30.807455 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0751104a-3443-41e2-93e7-0360a66a9c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:30.827604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 471/922] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:30 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:30.853809 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d826040-ea4b-4946-a0be-89727e7361d2 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:30.865789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d826040-ea4b-4946-a0be-89727e7361d2 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:30.870695 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac94c1-8fc4-43b4-a875-1f499e912358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:30.871461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac94c1-8fc4-43b4-a875-1f499e912358 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:30.871737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac94c1-8fc4-43b4-a875-1f499e912358 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:30.872005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac94c1-8fc4-43b4-a875-1f499e912358 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:30.873184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac94c1-8fc4-43b4-a875-1f499e912358 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:30.874863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac94c1-8fc4-43b4-a875-1f499e912358 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:30.876476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 452/923] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:30.883063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751104a-3443-41e2-93e7-0360a66a9c19 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:30.892050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751104a-3443-41e2-93e7-0360a66a9c19 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:30.896496 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5de55-f30f-4fba-b205-1f6249e2c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:30.897145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5de55-f30f-4fba-b205-1f6249e2c509 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:30.897462 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5de55-f30f-4fba-b205-1f6249e2c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:30.897737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5de55-f30f-4fba-b205-1f6249e2c509 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:30.898447 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5de55-f30f-4fba-b205-1f6249e2c509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:30.900380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5de55-f30f-4fba-b205-1f6249e2c509 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:31.055200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 472/924] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:25:30 2021] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:31.633938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc3057-eaea-4b0f-9aa4-c56eeb4a718e None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.634299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc3057-eaea-4b0f-9aa4-c56eeb4a718e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.634500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc3057-eaea-4b0f-9aa4-c56eeb4a718e None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.636381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 453/925] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:31.642158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75776-f44b-4a38-8b70-359975fe58e6 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.642530 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75776-f44b-4a38-8b70-359975fe58e6 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.642876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75776-f44b-4a38-8b70-359975fe58e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.662117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-76c75776-f44b-4a38-8b70-359975fe58e6 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:31.663512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-76c75776-f44b-4a38-8b70-359975fe58e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:31.732616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 473/926] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:31 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:31.751467 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23f39c-aae7-4ed9-b49d-0a483cae3ff7 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.751741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23f39c-aae7-4ed9-b49d-0a483cae3ff7 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.752014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23f39c-aae7-4ed9-b49d-0a483cae3ff7 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.753832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 454/927] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:31.756371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75776-f44b-4a38-8b70-359975fe58e6 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:31.760218 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ee116-cbfa-44b8-a972-f0b6e9149c80 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.760553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ee116-cbfa-44b8-a972-f0b6e9149c80 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.760834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ee116-cbfa-44b8-a972-f0b6e9149c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.766269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75776-f44b-4a38-8b70-359975fe58e6 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:31.771621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf365e-9c85-4710-80d5-dcc4d1c8d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:31.773026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf365e-9c85-4710-80d5-dcc4d1c8d963 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.773273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf365e-9c85-4710-80d5-dcc4d1c8d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.773543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf365e-9c85-4710-80d5-dcc4d1c8d963 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.774201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf365e-9c85-4710-80d5-dcc4d1c8d963 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:31.775959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf365e-9c85-4710-80d5-dcc4d1c8d963 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:31.784739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e15ee116-cbfa-44b8-a972-f0b6e9149c80 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:31.785940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e15ee116-cbfa-44b8-a972-f0b6e9149c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:31.787055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-a8cf365e-9c85-4710-80d5-dcc4d1c8d963 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:25:31.788620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 474/928] 10.222.0.25 () {56 vars in 1127 bytes} [Fri Aug 27 04:25:31 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:31.796453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 455/929] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:31 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:31.796595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf365e-9c85-4710-80d5-dcc4d1c8d963 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:31.809362 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf365e-9c85-4710-80d5-dcc4d1c8d963 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:31.813951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd45cb5-0703-4a3c-a20a-f0b5892a7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:31.814613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45cb5-0703-4a3c-a20a-f0b5892a7ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.814895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45cb5-0703-4a3c-a20a-f0b5892a7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.815172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45cb5-0703-4a3c-a20a-f0b5892a7ab7 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.815883 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45cb5-0703-4a3c-a20a-f0b5892a7ab7 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:31.816188 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45cb5-0703-4a3c-a20a-f0b5892a7ab7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:31.817803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45cb5-0703-4a3c-a20a-f0b5892a7ab7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:31.819989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ee116-cbfa-44b8-a972-f0b6e9149c80 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:31.823712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 475/930] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:31 2021] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:31.829296 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ee116-cbfa-44b8-a972-f0b6e9149c80 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:31.830105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd45cb5-0703-4a3c-a20a-f0b5892a7ab7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:31.833930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eded0e-93fd-4ffa-934f-6750e665a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:31.834765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eded0e-93fd-4ffa-934f-6750e665a34e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.835600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eded0e-93fd-4ffa-934f-6750e665a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.835876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eded0e-93fd-4ffa-934f-6750e665a34e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.840898 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd45cb5-0703-4a3c-a20a-f0b5892a7ab7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:31.845551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0fc5f-60b2-4192-8cd7-a6cbeaf45bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:31.846195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0fc5f-60b2-4192-8cd7-a6cbeaf45bda admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.846480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0fc5f-60b2-4192-8cd7-a6cbeaf45bda admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.846588 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eded0e-93fd-4ffa-934f-6750e665a34e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:31.846752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0fc5f-60b2-4192-8cd7-a6cbeaf45bda admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.847449 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0fc5f-60b2-4192-8cd7-a6cbeaf45bda admin admin] RBAC: Adding query filter params (type=image) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:31.847748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0fc5f-60b2-4192-8cd7-a6cbeaf45bda admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:31.849333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0fc5f-60b2-4192-8cd7-a6cbeaf45bda admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:31.853931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-b7eded0e-93fd-4ffa-934f-6750e665a34e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:25:31.859687 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 476/931] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:31 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:31.859818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 456/932] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 04:25:31 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:31.861750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0fc5f-60b2-4192-8cd7-a6cbeaf45bda admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:31.861997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eded0e-93fd-4ffa-934f-6750e665a34e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:31.871199 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0fc5f-60b2-4192-8cd7-a6cbeaf45bda admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:31.872179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eded0e-93fd-4ffa-934f-6750e665a34e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:31.875634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979a6a2-bd1c-4011-9105-5af668d4b140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:31.876271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979a6a2-bd1c-4011-9105-5af668d4b140 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.876580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979a6a2-bd1c-4011-9105-5af668d4b140 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.876690 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233a502-35ab-4a11-b377-5992b437d1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:31.876874 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979a6a2-bd1c-4011-9105-5af668d4b140 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.877290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233a502-35ab-4a11-b377-5992b437d1cb admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.877577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233a502-35ab-4a11-b377-5992b437d1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.877686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979a6a2-bd1c-4011-9105-5af668d4b140 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:31.877839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233a502-35ab-4a11-b377-5992b437d1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.878583 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233a502-35ab-4a11-b377-5992b437d1cb admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:31.878887 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233a502-35ab-4a11-b377-5992b437d1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:31.879134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979a6a2-bd1c-4011-9105-5af668d4b140 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:31.880498 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233a502-35ab-4a11-b377-5992b437d1cb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:31.894777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 457/933] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 04:25:31 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:31.896143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233a502-35ab-4a11-b377-5992b437d1cb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:31.906168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233a502-35ab-4a11-b377-5992b437d1cb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:31.910623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75d848-c30a-4bdc-b64a-acdd4fab9fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:31.911388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75d848-c30a-4bdc-b64a-acdd4fab9fcc admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.911669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75d848-c30a-4bdc-b64a-acdd4fab9fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.911943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75d848-c30a-4bdc-b64a-acdd4fab9fcc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.922268 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75d848-c30a-4bdc-b64a-acdd4fab9fcc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:31.924105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75d848-c30a-4bdc-b64a-acdd4fab9fcc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:31.941063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-3a75d848-c30a-4bdc-b64a-acdd4fab9fcc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:31.942276 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 458/934] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:31.949256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75d848-c30a-4bdc-b64a-acdd4fab9fcc admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:31.963147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75d848-c30a-4bdc-b64a-acdd4fab9fcc admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:31.968312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b62038-9114-47cc-8013-59f742353342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:31.969022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b62038-9114-47cc-8013-59f742353342 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:31.969300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b62038-9114-47cc-8013-59f742353342 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:31.969572 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b62038-9114-47cc-8013-59f742353342 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:31.970293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b62038-9114-47cc-8013-59f742353342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:31.970591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b62038-9114-47cc-8013-59f742353342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:31.972224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b62038-9114-47cc-8013-59f742353342 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:31.989574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 459/935] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:31.990740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b62038-9114-47cc-8013-59f742353342 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:31.996682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 477/936] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 04:25:31 2021] POST /identity/v3/endpoints => generated 327 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:25:32.000934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b62038-9114-47cc-8013-59f742353342 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:32.022219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b69b07-895f-44c9-82f7-3d39c58fe8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:32.023047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b69b07-895f-44c9-82f7-3d39c58fe8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:32.023323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b69b07-895f-44c9-82f7-3d39c58fe8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:32.023590 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b69b07-895f-44c9-82f7-3d39c58fe8b0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:32.032094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b69b07-895f-44c9-82f7-3d39c58fe8b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:32.034214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b69b07-895f-44c9-82f7-3d39c58fe8b0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:32.049257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-13b69b07-895f-44c9-82f7-3d39c58fe8b0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:25:32.050755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 460/937] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 04:25:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:32.058274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979a6a2-bd1c-4011-9105-5af668d4b140 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:32.070313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979a6a2-bd1c-4011-9105-5af668d4b140 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:32.076676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fced1-3e24-476a-84bb-73ab0908cd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:32.077679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fced1-3e24-476a-84bb-73ab0908cd88 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:32.078031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fced1-3e24-476a-84bb-73ab0908cd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:32.078379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fced1-3e24-476a-84bb-73ab0908cd88 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:32.079362 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fced1-3e24-476a-84bb-73ab0908cd88 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:32.079746 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fced1-3e24-476a-84bb-73ab0908cd88 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:32.081783 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fced1-3e24-476a-84bb-73ab0908cd88 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:32.104424 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 478/938] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 04:25:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:32.111122 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b69b07-895f-44c9-82f7-3d39c58fe8b0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:32.122389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b69b07-895f-44c9-82f7-3d39c58fe8b0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:32.127379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9366f-2e84-403e-8765-703ad71eb033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:32.128035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9366f-2e84-403e-8765-703ad71eb033 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:32.128321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9366f-2e84-403e-8765-703ad71eb033 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:32.128634 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9366f-2e84-403e-8765-703ad71eb033 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:32.138219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9366f-2e84-403e-8765-703ad71eb033 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:32.140042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9366f-2e84-403e-8765-703ad71eb033 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:32.151030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 461/939] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:32 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:32.157656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fced1-3e24-476a-84bb-73ab0908cd88 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:32.170111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fced1-3e24-476a-84bb-73ab0908cd88 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:32.175211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ad218-e0ca-4ba8-abe1-26cfbbca9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:32.176025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ad218-e0ca-4ba8-abe1-26cfbbca9dce admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:32.176306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ad218-e0ca-4ba8-abe1-26cfbbca9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:32.176609 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ad218-e0ca-4ba8-abe1-26cfbbca9dce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:32.190392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ad218-e0ca-4ba8-abe1-26cfbbca9dce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:32.192269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ad218-e0ca-4ba8-abe1-26cfbbca9dce admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:32.218275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-c64ad218-e0ca-4ba8-abe1-26cfbbca9dce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:32.220432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 479/940] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:32.227150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9366f-2e84-403e-8765-703ad71eb033 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:32.239007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9366f-2e84-403e-8765-703ad71eb033 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:32.244519 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b4a5d-488f-4d53-baef-02587df1d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:32.245185 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b4a5d-488f-4d53-baef-02587df1d49c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:32.245455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b4a5d-488f-4d53-baef-02587df1d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:32.245728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b4a5d-488f-4d53-baef-02587df1d49c admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:32.246454 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b4a5d-488f-4d53-baef-02587df1d49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:32.246755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b4a5d-488f-4d53-baef-02587df1d49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:32.248383 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b4a5d-488f-4d53-baef-02587df1d49c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:32.265129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 462/941] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:32.275640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ad218-e0ca-4ba8-abe1-26cfbbca9dce admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:32.289927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ad218-e0ca-4ba8-abe1-26cfbbca9dce admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:32.297332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc0892-0e23-45bc-9ddf-2735d8b20bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:32.298279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc0892-0e23-45bc-9ddf-2735d8b20bad admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:32.298718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc0892-0e23-45bc-9ddf-2735d8b20bad admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:32.299135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc0892-0e23-45bc-9ddf-2735d8b20bad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:32.312505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc0892-0e23-45bc-9ddf-2735d8b20bad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:32.316140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc0892-0e23-45bc-9ddf-2735d8b20bad admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:32.336580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-c1fc0892-0e23-45bc-9ddf-2735d8b20bad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:32.338008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 480/942] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:32.344650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b4a5d-488f-4d53-baef-02587df1d49c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:32.357084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b4a5d-488f-4d53-baef-02587df1d49c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:32.364497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dc7f1-f676-4034-8d72-ceb72cf1ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:32.365586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dc7f1-f676-4034-8d72-ceb72cf1ad6c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:32.366008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dc7f1-f676-4034-8d72-ceb72cf1ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:32.366885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dc7f1-f676-4034-8d72-ceb72cf1ad6c admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:32.368076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dc7f1-f676-4034-8d72-ceb72cf1ad6c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:32.368685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dc7f1-f676-4034-8d72-ceb72cf1ad6c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:32.371679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dc7f1-f676-4034-8d72-ceb72cf1ad6c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:32.389237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 463/943] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:32.398214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc0892-0e23-45bc-9ddf-2735d8b20bad admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:32.414891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc0892-0e23-45bc-9ddf-2735d8b20bad admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:32.421817 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a4074-eca2-4025-b66f-78b5d3ae9205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:32.422752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4074-eca2-4025-b66f-78b5d3ae9205 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:32.423126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4074-eca2-4025-b66f-78b5d3ae9205 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:32.423542 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4074-eca2-4025-b66f-78b5d3ae9205 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:32.424886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a4074-eca2-4025-b66f-78b5d3ae9205 admin admin] RBAC: Adding query filter params (role.id=a32916cfae1a48aa8c0f718bc14b2cb4, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=6812bbce1050419ea721a9b648b87bef) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:32.425269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a4074-eca2-4025-b66f-78b5d3ae9205 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:32.427305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a4074-eca2-4025-b66f-78b5d3ae9205 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:32.434505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 481/944] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:32 2021] GET /identity/v3/role_assignments?user.id=6812bbce1050419ea721a9b648b87bef&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=a32916cfae1a48aa8c0f718bc14b2cb4 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:33.296476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5161d3-7750-4098-84c4-117f13059284 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:33.296985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5161d3-7750-4098-84c4-117f13059284 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:33.297093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5161d3-7750-4098-84c4-117f13059284 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:33.298980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 464/945] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:33.304972 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050bfe-7fc1-4f8d-b5bb-ca1267fff98a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:33.305399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050bfe-7fc1-4f8d-b5bb-ca1267fff98a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:33.305586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050bfe-7fc1-4f8d-b5bb-ca1267fff98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:33.324445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-8a050bfe-7fc1-4f8d-b5bb-ca1267fff98a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:33.325656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8a050bfe-7fc1-4f8d-b5bb-ca1267fff98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:33.333465 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 482/946] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:25:33.359442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5161d3-7750-4098-84c4-117f13059284 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:33.371643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5161d3-7750-4098-84c4-117f13059284 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:33.376007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417b9c-e069-4a67-8eba-bae7a622a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:33.376887 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417b9c-e069-4a67-8eba-bae7a622a3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:33.377172 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417b9c-e069-4a67-8eba-bae7a622a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:33.377448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417b9c-e069-4a67-8eba-bae7a622a3d1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:33.378610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417b9c-e069-4a67-8eba-bae7a622a3d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:33.380315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417b9c-e069-4a67-8eba-bae7a622a3d1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:33.382587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 465/947] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:33.389070 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050bfe-7fc1-4f8d-b5bb-ca1267fff98a None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:33.398744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050bfe-7fc1-4f8d-b5bb-ca1267fff98a None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:33.403262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83940477-49f9-48e9-9b12-e06dbffe399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:33.403920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83940477-49f9-48e9-9b12-e06dbffe399a admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:33.404204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83940477-49f9-48e9-9b12-e06dbffe399a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:33.404533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83940477-49f9-48e9-9b12-e06dbffe399a admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:33.405231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83940477-49f9-48e9-9b12-e06dbffe399a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:33.407131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83940477-49f9-48e9-9b12-e06dbffe399a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:33.510900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 483/948] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:25:33 2021] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:25:34.198834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c577e7-7d91-438f-a7c6-2e1ca7b6eedd None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.199208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c577e7-7d91-438f-a7c6-2e1ca7b6eedd None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.199403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c577e7-7d91-438f-a7c6-2e1ca7b6eedd None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.201362 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 466/949] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:34.206957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df888b2f-6e5a-4571-9c87-ebc5355bd4e7 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.207244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df888b2f-6e5a-4571-9c87-ebc5355bd4e7 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.207518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df888b2f-6e5a-4571-9c87-ebc5355bd4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.225113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-df888b2f-6e5a-4571-9c87-ebc5355bd4e7 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:34.226833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-df888b2f-6e5a-4571-9c87-ebc5355bd4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:34.234538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 484/950] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:34.257126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c577e7-7d91-438f-a7c6-2e1ca7b6eedd None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:34.269703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c577e7-7d91-438f-a7c6-2e1ca7b6eedd None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:34.274566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8627a-c06b-481d-bb00-c525b9c8f602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:34.275198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8627a-c06b-481d-bb00-c525b9c8f602 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.275472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8627a-c06b-481d-bb00-c525b9c8f602 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.275743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8627a-c06b-481d-bb00-c525b9c8f602 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.283582 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8627a-c06b-481d-bb00-c525b9c8f602 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:34.285360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8627a-c06b-481d-bb00-c525b9c8f602 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:34.295347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 467/951] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:34.301472 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df888b2f-6e5a-4571-9c87-ebc5355bd4e7 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:34.310332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df888b2f-6e5a-4571-9c87-ebc5355bd4e7 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:34.314849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64370f-120b-4773-86c0-3c1e6f3f4795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:34.315700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64370f-120b-4773-86c0-3c1e6f3f4795 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.316053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64370f-120b-4773-86c0-3c1e6f3f4795 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.316422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64370f-120b-4773-86c0-3c1e6f3f4795 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.317643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64370f-120b-4773-86c0-3c1e6f3f4795 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:34.319409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64370f-120b-4773-86c0-3c1e6f3f4795 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:34.321284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 485/952] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:34.664211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82368480-611b-4cf9-9edd-4de3d435844d None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.664755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82368480-611b-4cf9-9edd-4de3d435844d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.664860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82368480-611b-4cf9-9edd-4de3d435844d None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.666616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 468/953] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:34.672946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8806f-eaad-4346-88b8-29013eb1b9c0 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.673235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8806f-eaad-4346-88b8-29013eb1b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.673515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8806f-eaad-4346-88b8-29013eb1b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.691416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d9e8806f-eaad-4346-88b8-29013eb1b9c0 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:34.692692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d9e8806f-eaad-4346-88b8-29013eb1b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:34.700404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 486/954] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:34.723921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82368480-611b-4cf9-9edd-4de3d435844d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:34.736440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82368480-611b-4cf9-9edd-4de3d435844d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:34.740824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8395c5-c800-4427-8532-52a54a6b9e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:34.742205 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8395c5-c800-4427-8532-52a54a6b9e2c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.742749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8395c5-c800-4427-8532-52a54a6b9e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.742912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8395c5-c800-4427-8532-52a54a6b9e2c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.753902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8395c5-c800-4427-8532-52a54a6b9e2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:34.761506 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-7d8395c5-c800-4427-8532-52a54a6b9e2c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:25:34.762948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 469/955] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 04:25:34 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:34.769627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8806f-eaad-4346-88b8-29013eb1b9c0 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:34.778908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8806f-eaad-4346-88b8-29013eb1b9c0 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:34.783441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237e23e-df2c-4932-b769-dcca7bf6ac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:34.784100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e23e-df2c-4932-b769-dcca7bf6ac4b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.784407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e23e-df2c-4932-b769-dcca7bf6ac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.784691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e23e-df2c-4932-b769-dcca7bf6ac4b admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.785427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237e23e-df2c-4932-b769-dcca7bf6ac4b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:34.785729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237e23e-df2c-4932-b769-dcca7bf6ac4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:34.787314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237e23e-df2c-4932-b769-dcca7bf6ac4b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:34.796382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 487/956] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 04:25:34 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:34.802733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8395c5-c800-4427-8532-52a54a6b9e2c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:34.813779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8395c5-c800-4427-8532-52a54a6b9e2c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:34.818456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a01c0-25f0-4e22-85aa-bde50999e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:34.819255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a01c0-25f0-4e22-85aa-bde50999e791 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.819537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a01c0-25f0-4e22-85aa-bde50999e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.819813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a01c0-25f0-4e22-85aa-bde50999e791 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.830107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a01c0-25f0-4e22-85aa-bde50999e791 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:34.832067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a01c0-25f0-4e22-85aa-bde50999e791 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:34.850009 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-5d1a01c0-25f0-4e22-85aa-bde50999e791 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:34.851843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 470/957] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:34.858133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237e23e-df2c-4932-b769-dcca7bf6ac4b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:34.867817 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237e23e-df2c-4932-b769-dcca7bf6ac4b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:34.872274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f2161-d143-4e96-ab56-35c129682d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:34.872949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2161-d143-4e96-ab56-35c129682d17 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.873234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2161-d143-4e96-ab56-35c129682d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.873513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2161-d143-4e96-ab56-35c129682d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.874228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2161-d143-4e96-ab56-35c129682d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:34.874535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2161-d143-4e96-ab56-35c129682d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:34.876133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2161-d143-4e96-ab56-35c129682d17 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:34.888154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 488/958] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:34.894980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a01c0-25f0-4e22-85aa-bde50999e791 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:34.905827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a01c0-25f0-4e22-85aa-bde50999e791 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:34.910540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a22c-19b1-4ae0-8c48-fd17ed11525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:34.911308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a22c-19b1-4ae0-8c48-fd17ed11525b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.911590 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a22c-19b1-4ae0-8c48-fd17ed11525b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.911860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a22c-19b1-4ae0-8c48-fd17ed11525b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.919713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8a22c-19b1-4ae0-8c48-fd17ed11525b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:34.921754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8a22c-19b1-4ae0-8c48-fd17ed11525b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:34.936403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-44f8a22c-19b1-4ae0-8c48-fd17ed11525b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:25:34.937802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 471/959] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 04:25:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:34.944288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f2161-d143-4e96-ab56-35c129682d17 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:34.965499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f2161-d143-4e96-ab56-35c129682d17 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:34.970275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc9f46-eb73-4062-8240-2c60e2967911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:34.970948 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9f46-eb73-4062-8240-2c60e2967911 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:34.971226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9f46-eb73-4062-8240-2c60e2967911 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:34.971787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9f46-eb73-4062-8240-2c60e2967911 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:34.972656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc9f46-eb73-4062-8240-2c60e2967911 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:34.972958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc9f46-eb73-4062-8240-2c60e2967911 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:34.974788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc9f46-eb73-4062-8240-2c60e2967911 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:34.992993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 489/960] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 04:25:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:34.999408 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a22c-19b1-4ae0-8c48-fd17ed11525b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:35.009861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a22c-19b1-4ae0-8c48-fd17ed11525b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:35.014447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cdd6d-b3f8-4a37-bb98-e81e37f4ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:35.015225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdd6d-b3f8-4a37-bb98-e81e37f4ee6b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.015505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdd6d-b3f8-4a37-bb98-e81e37f4ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.015791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdd6d-b3f8-4a37-bb98-e81e37f4ee6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:35.026331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cdd6d-b3f8-4a37-bb98-e81e37f4ee6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:35.028199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cdd6d-b3f8-4a37-bb98-e81e37f4ee6b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:35.045639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-e37cdd6d-b3f8-4a37-bb98-e81e37f4ee6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:35.046858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 472/961] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:35.053308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc9f46-eb73-4062-8240-2c60e2967911 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:35.063535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc9f46-eb73-4062-8240-2c60e2967911 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:35.068128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd17412-af06-48e9-96a0-b398676afbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:35.068792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd17412-af06-48e9-96a0-b398676afbfe admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.069129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd17412-af06-48e9-96a0-b398676afbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.069897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd17412-af06-48e9-96a0-b398676afbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:35.070616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd17412-af06-48e9-96a0-b398676afbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:35.070919 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd17412-af06-48e9-96a0-b398676afbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:35.072518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd17412-af06-48e9-96a0-b398676afbfe admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:35.083462 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 490/962] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:35.089682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cdd6d-b3f8-4a37-bb98-e81e37f4ee6b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:35.099203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cdd6d-b3f8-4a37-bb98-e81e37f4ee6b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:35.103711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f177acc-b3a7-4a6d-89eb-2133fedbfb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:35.104630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f177acc-b3a7-4a6d-89eb-2133fedbfb0e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.104985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f177acc-b3a7-4a6d-89eb-2133fedbfb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.105304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f177acc-b3a7-4a6d-89eb-2133fedbfb0e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:35.112016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f177acc-b3a7-4a6d-89eb-2133fedbfb0e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:35.114005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f177acc-b3a7-4a6d-89eb-2133fedbfb0e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:35.131503 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-9f177acc-b3a7-4a6d-89eb-2133fedbfb0e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:35.133292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 473/963] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:35.140096 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd17412-af06-48e9-96a0-b398676afbfe admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:35.149760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd17412-af06-48e9-96a0-b398676afbfe admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:35.154182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1e316-69f1-44e4-9c32-6bc290986a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:35.154905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1e316-69f1-44e4-9c32-6bc290986a29 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.155189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1e316-69f1-44e4-9c32-6bc290986a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.155467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1e316-69f1-44e4-9c32-6bc290986a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:35.156240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1e316-69f1-44e4-9c32-6bc290986a29 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:35.156575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1e316-69f1-44e4-9c32-6bc290986a29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:35.158414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1e316-69f1-44e4-9c32-6bc290986a29 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:35.170845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 491/964] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:35.177571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f177acc-b3a7-4a6d-89eb-2133fedbfb0e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:35.188608 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f177acc-b3a7-4a6d-89eb-2133fedbfb0e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:35.193090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04d385-9822-4dbe-8267-115b4e03f29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:35.193944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04d385-9822-4dbe-8267-115b4e03f29c admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.194266 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04d385-9822-4dbe-8267-115b4e03f29c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.194535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04d385-9822-4dbe-8267-115b4e03f29c admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/6812bbce1050419ea721a9b648b87bef/roles/a32916cfae1a48aa8c0f718bc14b2cb4` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:35.197292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04d385-9822-4dbe-8267-115b4e03f29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=6812bbce1050419ea721a9b648b87bef, role_id=a32916cfae1a48aa8c0f718bc14b2cb4)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:35.199945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04d385-9822-4dbe-8267-115b4e03f29c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:35.354758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 474/965] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:25:35 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/6812bbce1050419ea721a9b648b87bef/roles/a32916cfae1a48aa8c0f718bc14b2cb4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:25:35.749591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cb37c-9408-4607-bb9d-8e82d123ea39 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.750104 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cb37c-9408-4607-bb9d-8e82d123ea39 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.750187 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cb37c-9408-4607-bb9d-8e82d123ea39 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:35.751941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 492/966] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:35.757931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da803463-eb89-42e8-acee-0429dc4e5996 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.758357 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da803463-eb89-42e8-acee-0429dc4e5996 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.758483 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da803463-eb89-42e8-acee-0429dc4e5996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:35.776065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-da803463-eb89-42e8-acee-0429dc4e5996 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:35.777273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-da803463-eb89-42e8-acee-0429dc4e5996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:35.834098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 475/967] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:35.859249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cb37c-9408-4607-bb9d-8e82d123ea39 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:35.871299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cb37c-9408-4607-bb9d-8e82d123ea39 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:35.875578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149a05-dda5-4255-a92f-39bf7943e228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:35.876369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149a05-dda5-4255-a92f-39bf7943e228 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.876658 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149a05-dda5-4255-a92f-39bf7943e228 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.876933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149a05-dda5-4255-a92f-39bf7943e228 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:35.886956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00149a05-dda5-4255-a92f-39bf7943e228 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:35.893700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-00149a05-dda5-4255-a92f-39bf7943e228 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:25:35.894894 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 493/968] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:35.902451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da803463-eb89-42e8-acee-0429dc4e5996 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:35.911455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da803463-eb89-42e8-acee-0429dc4e5996 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:35.916508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fdc2b-ad69-452b-8631-4b31aae8dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:35.917158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fdc2b-ad69-452b-8631-4b31aae8dab3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.917780 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fdc2b-ad69-452b-8631-4b31aae8dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.918062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fdc2b-ad69-452b-8631-4b31aae8dab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:35.918810 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fdc2b-ad69-452b-8631-4b31aae8dab3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:35.919115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fdc2b-ad69-452b-8631-4b31aae8dab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:35.920755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fdc2b-ad69-452b-8631-4b31aae8dab3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:35.928834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 476/969] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:35.935059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149a05-dda5-4255-a92f-39bf7943e228 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:35.945297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149a05-dda5-4255-a92f-39bf7943e228 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:35.949982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b18965-133e-4117-a9b0-6d0cbe112fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:35.950830 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b18965-133e-4117-a9b0-6d0cbe112fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.951112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b18965-133e-4117-a9b0-6d0cbe112fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.951388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b18965-133e-4117-a9b0-6d0cbe112fd6 admin admin] PATH_INFO: `/v3/users/bc4f127a48234d9591294293a6ee068a` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:35.966479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b18965-133e-4117-a9b0-6d0cbe112fd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=bc4f127a48234d9591294293a6ee068a)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:35.968675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b18965-133e-4117-a9b0-6d0cbe112fd6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:35.970584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 494/970] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:25:35 2021] GET /identity/v3/users/bc4f127a48234d9591294293a6ee068a => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:35.977378 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fdc2b-ad69-452b-8631-4b31aae8dab3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:35.987075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fdc2b-ad69-452b-8631-4b31aae8dab3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:35.991597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcf2e3-6ed6-462d-b857-286be250580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:35.992223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf2e3-6ed6-462d-b857-286be250580f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:35.992540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf2e3-6ed6-462d-b857-286be250580f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:35.992819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf2e3-6ed6-462d-b857-286be250580f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:36.000393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcf2e3-6ed6-462d-b857-286be250580f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:36.002152 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcf2e3-6ed6-462d-b857-286be250580f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:36.010768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 477/971] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:35 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:36.017167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b18965-133e-4117-a9b0-6d0cbe112fd6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:36.027195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b18965-133e-4117-a9b0-6d0cbe112fd6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:36.031655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da9c2-03ca-42fc-9b9c-df577061a4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:36.032551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da9c2-03ca-42fc-9b9c-df577061a4cc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:36.032835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da9c2-03ca-42fc-9b9c-df577061a4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:36.033109 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da9c2-03ca-42fc-9b9c-df577061a4cc admin admin] PATH_INFO: `/v3/projects/433caccd464c42a085d7cc59c146af8c` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:36.034270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111da9c2-03ca-42fc-9b9c-df577061a4cc admin admin] RBAC: Authorizing `identity:get_project(project_id=433caccd464c42a085d7cc59c146af8c)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:36.036309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111da9c2-03ca-42fc-9b9c-df577061a4cc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:36.038557 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 495/972] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:25:36 2021] GET /identity/v3/projects/433caccd464c42a085d7cc59c146af8c => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:36.045554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcf2e3-6ed6-462d-b857-286be250580f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:36.054590 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcf2e3-6ed6-462d-b857-286be250580f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:36.059478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed7810-d582-47aa-a4ea-a63f1da48129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:36.059774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7810-d582-47aa-a4ea-a63f1da48129 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:36.060054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7810-d582-47aa-a4ea-a63f1da48129 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:36.060325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7810-d582-47aa-a4ea-a63f1da48129 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:36.061200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed7810-d582-47aa-a4ea-a63f1da48129 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=433caccd464c42a085d7cc59c146af8c, user.id=bc4f127a48234d9591294293a6ee068a) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:36.061499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed7810-d582-47aa-a4ea-a63f1da48129 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:36.063345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed7810-d582-47aa-a4ea-a63f1da48129 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:36.069795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 478/973] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:36 2021] GET /identity/v3/role_assignments?user.id=bc4f127a48234d9591294293a6ee068a&scope.project.id=433caccd464c42a085d7cc59c146af8c&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:37.554679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0972-5dbd-49cc-93dc-ad27e7349b85 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.555228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0972-5dbd-49cc-93dc-ad27e7349b85 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.555228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0972-5dbd-49cc-93dc-ad27e7349b85 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.557195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 496/974] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:37.562836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e44d-8bdb-4884-b4cb-edbc33f6e5f2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.563218 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e44d-8bdb-4884-b4cb-edbc33f6e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.563781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e44d-8bdb-4884-b4cb-edbc33f6e5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.581595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-ba31e44d-8bdb-4884-b4cb-edbc33f6e5f2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:37.582785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ba31e44d-8bdb-4884-b4cb-edbc33f6e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:37.591177 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 479/975] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:37.615361 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd0972-5dbd-49cc-93dc-ad27e7349b85 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:37.627389 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd0972-5dbd-49cc-93dc-ad27e7349b85 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:37.632221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1045b8-5e2e-4de6-aa25-e52339cc4997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:37.633045 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1045b8-5e2e-4de6-aa25-e52339cc4997 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.633321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1045b8-5e2e-4de6-aa25-e52339cc4997 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.633592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1045b8-5e2e-4de6-aa25-e52339cc4997 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.643784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1045b8-5e2e-4de6-aa25-e52339cc4997 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:37.651488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-9d1045b8-5e2e-4de6-aa25-e52339cc4997 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:25:37.652692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 497/976] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 04:25:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:37.659261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e44d-8bdb-4884-b4cb-edbc33f6e5f2 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:37.668518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e44d-8bdb-4884-b4cb-edbc33f6e5f2 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:37.673006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef3e9-a631-441f-820d-a233dfed6b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:37.673656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef3e9-a631-441f-820d-a233dfed6b93 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.673935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef3e9-a631-441f-820d-a233dfed6b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.674209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef3e9-a631-441f-820d-a233dfed6b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.674976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef3e9-a631-441f-820d-a233dfed6b93 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:37.675281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef3e9-a631-441f-820d-a233dfed6b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:37.676934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef3e9-a631-441f-820d-a233dfed6b93 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:37.685381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 480/977] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 04:25:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:37.692084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1045b8-5e2e-4de6-aa25-e52339cc4997 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:37.702595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1045b8-5e2e-4de6-aa25-e52339cc4997 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:37.707095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa16ca-bcb1-467b-97b1-1f55e281dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:37.707866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa16ca-bcb1-467b-97b1-1f55e281dae3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.708152 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa16ca-bcb1-467b-97b1-1f55e281dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.708452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa16ca-bcb1-467b-97b1-1f55e281dae3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.719049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa16ca-bcb1-467b-97b1-1f55e281dae3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:37.720932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa16ca-bcb1-467b-97b1-1f55e281dae3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:37.736958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-c5fa16ca-bcb1-467b-97b1-1f55e281dae3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:37.738121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 498/978] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:25:37.744474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef3e9-a631-441f-820d-a233dfed6b93 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:37.754234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef3e9-a631-441f-820d-a233dfed6b93 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:37.759376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3f88-59f6-4937-ae75-650072b9c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:37.760030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3f88-59f6-4937-ae75-650072b9c792 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.760314 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3f88-59f6-4937-ae75-650072b9c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.760620 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3f88-59f6-4937-ae75-650072b9c792 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.761339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3f88-59f6-4937-ae75-650072b9c792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:37.761646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3f88-59f6-4937-ae75-650072b9c792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:37.763263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3f88-59f6-4937-ae75-650072b9c792 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:37.775826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 481/979] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:37.782108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa16ca-bcb1-467b-97b1-1f55e281dae3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:37.791639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa16ca-bcb1-467b-97b1-1f55e281dae3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:37.796373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aa36c-1efc-46d1-bf97-a99a0a90f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:37.797136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa36c-1efc-46d1-bf97-a99a0a90f631 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.797416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa36c-1efc-46d1-bf97-a99a0a90f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.797688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa36c-1efc-46d1-bf97-a99a0a90f631 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.804959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aa36c-1efc-46d1-bf97-a99a0a90f631 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:37.806945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aa36c-1efc-46d1-bf97-a99a0a90f631 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:37.822482 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-256aa36c-1efc-46d1-bf97-a99a0a90f631 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:25:37.823673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 499/980] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 04:25:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:37.829947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3f88-59f6-4937-ae75-650072b9c792 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:37.840207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3f88-59f6-4937-ae75-650072b9c792 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:37.844798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96ec64-4717-4dd8-a6de-e024ef1b6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:37.845441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96ec64-4717-4dd8-a6de-e024ef1b6cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.845719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96ec64-4717-4dd8-a6de-e024ef1b6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.845988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96ec64-4717-4dd8-a6de-e024ef1b6cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.846810 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96ec64-4717-4dd8-a6de-e024ef1b6cf3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:37.847118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96ec64-4717-4dd8-a6de-e024ef1b6cf3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:37.848994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96ec64-4717-4dd8-a6de-e024ef1b6cf3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:37.866170 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 482/981] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 04:25:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:37.872465 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aa36c-1efc-46d1-bf97-a99a0a90f631 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:37.882600 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aa36c-1efc-46d1-bf97-a99a0a90f631 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:37.887153 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118aab-cf97-45cb-88db-244aa88a94f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:37.887788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118aab-cf97-45cb-88db-244aa88a94f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.888076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118aab-cf97-45cb-88db-244aa88a94f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.888373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118aab-cf97-45cb-88db-244aa88a94f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.896186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4118aab-cf97-45cb-88db-244aa88a94f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:37.898572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4118aab-cf97-45cb-88db-244aa88a94f9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:37.907431 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 500/982] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:37 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:37.913828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96ec64-4717-4dd8-a6de-e024ef1b6cf3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:37.923639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96ec64-4717-4dd8-a6de-e024ef1b6cf3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:37.928093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956df491-1aa3-478d-96d2-f8244e374ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:37.929405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956df491-1aa3-478d-96d2-f8244e374ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.929686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956df491-1aa3-478d-96d2-f8244e374ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.929957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956df491-1aa3-478d-96d2-f8244e374ad8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.939816 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956df491-1aa3-478d-96d2-f8244e374ad8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:37.941713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956df491-1aa3-478d-96d2-f8244e374ad8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:37.958845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-956df491-1aa3-478d-96d2-f8244e374ad8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:25:37.960083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 483/983] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:37.966328 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118aab-cf97-45cb-88db-244aa88a94f9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:37.975491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118aab-cf97-45cb-88db-244aa88a94f9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:37.980126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36173b-9fa5-4923-bc4a-f1d334b73e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:37.980875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36173b-9fa5-4923-bc4a-f1d334b73e50 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:37.981224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36173b-9fa5-4923-bc4a-f1d334b73e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:37.981569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36173b-9fa5-4923-bc4a-f1d334b73e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:37.982365 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36173b-9fa5-4923-bc4a-f1d334b73e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:37.982736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36173b-9fa5-4923-bc4a-f1d334b73e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:37.984421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36173b-9fa5-4923-bc4a-f1d334b73e50 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:37.996033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 501/984] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:25:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:38.003468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956df491-1aa3-478d-96d2-f8244e374ad8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:38.013953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956df491-1aa3-478d-96d2-f8244e374ad8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:38.018838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df7fef-0d88-4345-b3e0-96e6b4878366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:38.019616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df7fef-0d88-4345-b3e0-96e6b4878366 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:38.019900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df7fef-0d88-4345-b3e0-96e6b4878366 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:38.020177 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df7fef-0d88-4345-b3e0-96e6b4878366 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:38.027191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df7fef-0d88-4345-b3e0-96e6b4878366 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:38.029193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df7fef-0d88-4345-b3e0-96e6b4878366 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:38.041948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-f5df7fef-0d88-4345-b3e0-96e6b4878366 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:25:38.043571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 484/985] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:25:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:38.049928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36173b-9fa5-4923-bc4a-f1d334b73e50 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:38.060302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36173b-9fa5-4923-bc4a-f1d334b73e50 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:38.064857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6092ad-58ff-4aa1-b77c-87b8acfb97df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:38.065497 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6092ad-58ff-4aa1-b77c-87b8acfb97df admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:38.065784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6092ad-58ff-4aa1-b77c-87b8acfb97df admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:38.066060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6092ad-58ff-4aa1-b77c-87b8acfb97df admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:38.066843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6092ad-58ff-4aa1-b77c-87b8acfb97df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:38.067182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6092ad-58ff-4aa1-b77c-87b8acfb97df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:38.069658 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6092ad-58ff-4aa1-b77c-87b8acfb97df admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:38.081699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 502/986] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:25:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:38.088554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df7fef-0d88-4345-b3e0-96e6b4878366 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:38.098935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df7fef-0d88-4345-b3e0-96e6b4878366 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:38.103627 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308de2-d9d7-473d-a1eb-700604e0d091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:38.104274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308de2-d9d7-473d-a1eb-700604e0d091 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:38.104586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308de2-d9d7-473d-a1eb-700604e0d091 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:38.104880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308de2-d9d7-473d-a1eb-700604e0d091 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:38.105683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308de2-d9d7-473d-a1eb-700604e0d091 admin admin] RBAC: Adding query filter params (role.id=a32916cfae1a48aa8c0f718bc14b2cb4, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=6812bbce1050419ea721a9b648b87bef) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:38.105998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308de2-d9d7-473d-a1eb-700604e0d091 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:38.107851 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308de2-d9d7-473d-a1eb-700604e0d091 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:38.114483 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 485/987] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:38 2021] GET /identity/v3/role_assignments?user.id=6812bbce1050419ea721a9b648b87bef&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=a32916cfae1a48aa8c0f718bc14b2cb4 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:38.202978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a985-f2a3-4294-a67b-41d0c9c9eeca None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:38.203267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a985-f2a3-4294-a67b-41d0c9c9eeca None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:38.203550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a985-f2a3-4294-a67b-41d0c9c9eeca None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:38.205429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 503/988] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:38.211977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab22323-d191-4dfd-9c5c-0ef6039123ca None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:38.212263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab22323-d191-4dfd-9c5c-0ef6039123ca None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:38.212577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab22323-d191-4dfd-9c5c-0ef6039123ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:38.230229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-bab22323-d191-4dfd-9c5c-0ef6039123ca None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:38.231479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-bab22323-d191-4dfd-9c5c-0ef6039123ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:38.239603 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 486/989] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:38.264777 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1a985-f2a3-4294-a67b-41d0c9c9eeca None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:38.277733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1a985-f2a3-4294-a67b-41d0c9c9eeca None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:38.282632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6653a-00e5-4de2-af04-e3a054290e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:38.283426 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6653a-00e5-4de2-af04-e3a054290e2f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:38.283712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6653a-00e5-4de2-af04-e3a054290e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:38.283990 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6653a-00e5-4de2-af04-e3a054290e2f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:38.296114 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6653a-00e5-4de2-af04-e3a054290e2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:38.302960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-f7e6653a-00e5-4de2-af04-e3a054290e2f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:25:38.305093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 504/990] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:38.312282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab22323-d191-4dfd-9c5c-0ef6039123ca None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:38.321607 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab22323-d191-4dfd-9c5c-0ef6039123ca None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:38.326351 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fd08c-8315-409d-a312-5eab5af69a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:38.327011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fd08c-8315-409d-a312-5eab5af69a6b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:38.327295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fd08c-8315-409d-a312-5eab5af69a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:38.327569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fd08c-8315-409d-a312-5eab5af69a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:38.328322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fd08c-8315-409d-a312-5eab5af69a6b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:38.328669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fd08c-8315-409d-a312-5eab5af69a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:38.330270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fd08c-8315-409d-a312-5eab5af69a6b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:38.338904 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 487/991] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:38.345764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6653a-00e5-4de2-af04-e3a054290e2f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:38.357712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6653a-00e5-4de2-af04-e3a054290e2f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:38.362657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db4ac1-d2d5-42bd-9a95-66ca006fc5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:38.363544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db4ac1-d2d5-42bd-9a95-66ca006fc5ee admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:38.363834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db4ac1-d2d5-42bd-9a95-66ca006fc5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:38.364109 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db4ac1-d2d5-42bd-9a95-66ca006fc5ee admin admin] PATH_INFO: `/v3/users/bc4f127a48234d9591294293a6ee068a` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:38.365374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db4ac1-d2d5-42bd-9a95-66ca006fc5ee admin admin] RBAC: Authorizing `identity:get_user(user_id=bc4f127a48234d9591294293a6ee068a)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:38.368225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db4ac1-d2d5-42bd-9a95-66ca006fc5ee admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:38.370334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 505/992] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:25:38 2021] GET /identity/v3/users/bc4f127a48234d9591294293a6ee068a => generated 285 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:38.377094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fd08c-8315-409d-a312-5eab5af69a6b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:38.387863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fd08c-8315-409d-a312-5eab5af69a6b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:38.392628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7e984-71a0-49b7-b99b-938551cd0cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:38.393532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7e984-71a0-49b7-b99b-938551cd0cca admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:38.393853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7e984-71a0-49b7-b99b-938551cd0cca admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:38.394134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7e984-71a0-49b7-b99b-938551cd0cca admin admin] PATH_INFO: `/v3/projects/433caccd464c42a085d7cc59c146af8c` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:38.395329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7e984-71a0-49b7-b99b-938551cd0cca admin admin] RBAC: Authorizing `identity:get_project(project_id=433caccd464c42a085d7cc59c146af8c)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:38.397528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7e984-71a0-49b7-b99b-938551cd0cca admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:38.399273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 488/993] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:25:38 2021] GET /identity/v3/projects/433caccd464c42a085d7cc59c146af8c => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:38.406210 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db4ac1-d2d5-42bd-9a95-66ca006fc5ee admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:38.417755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db4ac1-d2d5-42bd-9a95-66ca006fc5ee admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:38.422755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6307871-8659-4623-9689-fbcbd7a2d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:38.423638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6307871-8659-4623-9689-fbcbd7a2d801 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:38.423922 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6307871-8659-4623-9689-fbcbd7a2d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:38.424202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6307871-8659-4623-9689-fbcbd7a2d801 admin admin] PATH_INFO: `/v3/projects/433caccd464c42a085d7cc59c146af8c/users/bc4f127a48234d9591294293a6ee068a/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:38.426226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6307871-8659-4623-9689-fbcbd7a2d801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433caccd464c42a085d7cc59c146af8c, user_id=bc4f127a48234d9591294293a6ee068a, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:38.429489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6307871-8659-4623-9689-fbcbd7a2d801 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:38.524399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 506/994] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:25:38 2021] PUT /identity/v3/projects/433caccd464c42a085d7cc59c146af8c/users/bc4f127a48234d9591294293a6ee068a/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:25:40.717269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a74464-f45d-43c5-b35b-d14d4a071103 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:40.717888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a74464-f45d-43c5-b35b-d14d4a071103 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:40.717888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a74464-f45d-43c5-b35b-d14d4a071103 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:40.719574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 489/995] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:40.725772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60830c-f3f4-4307-afa6-ec1e303a37c8 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:40.726198 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60830c-f3f4-4307-afa6-ec1e303a37c8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:40.726322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60830c-f3f4-4307-afa6-ec1e303a37c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:40.744220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ed60830c-f3f4-4307-afa6-ec1e303a37c8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:40.745460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ed60830c-f3f4-4307-afa6-ec1e303a37c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:40.801678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 507/996] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:40.827485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a74464-f45d-43c5-b35b-d14d4a071103 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:40.840478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a74464-f45d-43c5-b35b-d14d4a071103 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:40.844988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93933f-36cd-4c14-b7db-ba0d909d252d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:40.845773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93933f-36cd-4c14-b7db-ba0d909d252d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:40.846051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93933f-36cd-4c14-b7db-ba0d909d252d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:40.846328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93933f-36cd-4c14-b7db-ba0d909d252d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:40.857196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93933f-36cd-4c14-b7db-ba0d909d252d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:40.863932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-5d93933f-36cd-4c14-b7db-ba0d909d252d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:25:40.865155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 490/997] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:40.872330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60830c-f3f4-4307-afa6-ec1e303a37c8 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:40.881907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60830c-f3f4-4307-afa6-ec1e303a37c8 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:40.887205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aea6d4-f0e3-49bd-894b-79c1b314e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:40.887890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aea6d4-f0e3-49bd-894b-79c1b314e8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:40.888206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aea6d4-f0e3-49bd-894b-79c1b314e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:40.888544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aea6d4-f0e3-49bd-894b-79c1b314e8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:40.889353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aea6d4-f0e3-49bd-894b-79c1b314e8a8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:40.889693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aea6d4-f0e3-49bd-894b-79c1b314e8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:40.891409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aea6d4-f0e3-49bd-894b-79c1b314e8a8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:40.900495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 508/998] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:40.906764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93933f-36cd-4c14-b7db-ba0d909d252d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:40.916183 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93933f-36cd-4c14-b7db-ba0d909d252d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:40.920938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf7f6-2901-4ff7-9a0b-39a88e8340ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:40.921776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf7f6-2901-4ff7-9a0b-39a88e8340ef admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:40.922076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf7f6-2901-4ff7-9a0b-39a88e8340ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:40.922446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf7f6-2901-4ff7-9a0b-39a88e8340ef admin admin] PATH_INFO: `/v3/users/bc4f127a48234d9591294293a6ee068a` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:40.923628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf7f6-2901-4ff7-9a0b-39a88e8340ef admin admin] RBAC: Authorizing `identity:get_user(user_id=bc4f127a48234d9591294293a6ee068a)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:40.925803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf7f6-2901-4ff7-9a0b-39a88e8340ef admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:40.927350 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 491/999] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:25:40 2021] GET /identity/v3/users/bc4f127a48234d9591294293a6ee068a => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:40.933873 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aea6d4-f0e3-49bd-894b-79c1b314e8a8 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:40.943047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aea6d4-f0e3-49bd-894b-79c1b314e8a8 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:40.948190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a4fbe-ea0b-4234-8acf-be78dfc9e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:40.948787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a4fbe-ea0b-4234-8acf-be78dfc9e471 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:40.949068 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a4fbe-ea0b-4234-8acf-be78dfc9e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:40.949338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a4fbe-ea0b-4234-8acf-be78dfc9e471 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:40.956945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a4fbe-ea0b-4234-8acf-be78dfc9e471 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:40.958677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a4fbe-ea0b-4234-8acf-be78dfc9e471 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:40.967636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 509/1000] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:40 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:40.974195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf7f6-2901-4ff7-9a0b-39a88e8340ef admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:40.983611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf7f6-2901-4ff7-9a0b-39a88e8340ef admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:40.988069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25d2fb-9ca9-4011-b042-be501bc0afe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:40.988930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25d2fb-9ca9-4011-b042-be501bc0afe3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:40.989208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25d2fb-9ca9-4011-b042-be501bc0afe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:40.989478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25d2fb-9ca9-4011-b042-be501bc0afe3 admin admin] PATH_INFO: `/v3/projects/433caccd464c42a085d7cc59c146af8c` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:40.990629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25d2fb-9ca9-4011-b042-be501bc0afe3 admin admin] RBAC: Authorizing `identity:get_project(project_id=433caccd464c42a085d7cc59c146af8c)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:40.993226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25d2fb-9ca9-4011-b042-be501bc0afe3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:40.994848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 492/1001] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:25:40 2021] GET /identity/v3/projects/433caccd464c42a085d7cc59c146af8c => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:41.001253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a4fbe-ea0b-4234-8acf-be78dfc9e471 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:41.010543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a4fbe-ea0b-4234-8acf-be78dfc9e471 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:41.015152 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e04ef-738a-4895-a8dd-db7e231fa0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:41.015784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e04ef-738a-4895-a8dd-db7e231fa0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:41.016067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e04ef-738a-4895-a8dd-db7e231fa0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:41.016343 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e04ef-738a-4895-a8dd-db7e231fa0d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:41.017211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e04ef-738a-4895-a8dd-db7e231fa0d8 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=433caccd464c42a085d7cc59c146af8c, user.id=bc4f127a48234d9591294293a6ee068a) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:41.017510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e04ef-738a-4895-a8dd-db7e231fa0d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:41.019322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e04ef-738a-4895-a8dd-db7e231fa0d8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:41.024876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 510/1002] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:41 2021] GET /identity/v3/role_assignments?user.id=bc4f127a48234d9591294293a6ee068a&scope.project.id=433caccd464c42a085d7cc59c146af8c&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:43.172975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f884a-4e96-48b6-84ba-e23dacab9941 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:43.173570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f884a-4e96-48b6-84ba-e23dacab9941 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:43.173570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f884a-4e96-48b6-84ba-e23dacab9941 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:43.175304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 493/1003] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:43.181915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c371adc-86c5-47ff-9e5a-2d3225f733da None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:43.182367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c371adc-86c5-47ff-9e5a-2d3225f733da None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:43.182460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c371adc-86c5-47ff-9e5a-2d3225f733da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:43.199445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-3c371adc-86c5-47ff-9e5a-2d3225f733da None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:43.200644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-3c371adc-86c5-47ff-9e5a-2d3225f733da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:43.208080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 511/1004] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:43.234198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f884a-4e96-48b6-84ba-e23dacab9941 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:43.246202 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f884a-4e96-48b6-84ba-e23dacab9941 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:43.250549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d053269-6277-4245-9240-e39c00d1ddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:43.251343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d053269-6277-4245-9240-e39c00d1ddbb admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:43.251628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d053269-6277-4245-9240-e39c00d1ddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:43.251905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d053269-6277-4245-9240-e39c00d1ddbb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:43.253078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d053269-6277-4245-9240-e39c00d1ddbb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:43.254765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d053269-6277-4245-9240-e39c00d1ddbb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:43.256327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 494/1005] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:43.262253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c371adc-86c5-47ff-9e5a-2d3225f733da None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:43.270876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c371adc-86c5-47ff-9e5a-2d3225f733da None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:43.275996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf4cad-fe46-4c63-b2d6-9dfb6b10bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:43.276675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf4cad-fe46-4c63-b2d6-9dfb6b10bdac admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:43.276957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf4cad-fe46-4c63-b2d6-9dfb6b10bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:43.277230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf4cad-fe46-4c63-b2d6-9dfb6b10bdac admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:43.277911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf4cad-fe46-4c63-b2d6-9dfb6b10bdac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:43.279793 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf4cad-fe46-4c63-b2d6-9dfb6b10bdac admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:43.385424 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 512/1006] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:25:43 2021] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:45.558120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca0e90-e622-4d61-992e-b73e8a2e12ba None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:45.558668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca0e90-e622-4d61-992e-b73e8a2e12ba None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:45.558668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca0e90-e622-4d61-992e-b73e8a2e12ba None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:45.560464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 495/1007] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:25:45.566224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e15d4-d355-416e-9ef9-947a5a4b82da None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:45.566676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e15d4-d355-416e-9ef9-947a5a4b82da None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:45.566792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e15d4-d355-416e-9ef9-947a5a4b82da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:45.585504 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-049e15d4-d355-416e-9ef9-947a5a4b82da None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:45.586708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-049e15d4-d355-416e-9ef9-947a5a4b82da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:45.594598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 513/1008] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:45.619495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca0e90-e622-4d61-992e-b73e8a2e12ba None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:45.631479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca0e90-e622-4d61-992e-b73e8a2e12ba None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:45.635805 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d1722-da3d-493c-baea-7d9ece5db8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:45.636671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d1722-da3d-493c-baea-7d9ece5db8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:45.636957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d1722-da3d-493c-baea-7d9ece5db8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:45.637236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d1722-da3d-493c-baea-7d9ece5db8b6 admin admin] PATH_INFO: `/v3/roles/3df7162472e345bd91ce9469ee6fe3f5` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:45.638702 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d1722-da3d-493c-baea-7d9ece5db8b6 admin admin] RBAC: Authorizing `identity:get_role(role_id=3df7162472e345bd91ce9469ee6fe3f5)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:45.639713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-df2d1722-da3d-493c-baea-7d9ece5db8b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:45.639713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:25:45.639713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:25:45.640627 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d1722-da3d-493c-baea-7d9ece5db8b6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:45.642060 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 496/1009] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:25:45 2021] GET /identity/v3/roles/3df7162472e345bd91ce9469ee6fe3f5 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:45.648946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e15d4-d355-416e-9ef9-947a5a4b82da None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:45.657687 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e15d4-d355-416e-9ef9-947a5a4b82da None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:45.662284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43e5a0-4c3f-4f21-b9be-af295fe4ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:45.663710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43e5a0-4c3f-4f21-b9be-af295fe4ae57 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:45.663985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43e5a0-4c3f-4f21-b9be-af295fe4ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:45.664255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43e5a0-4c3f-4f21-b9be-af295fe4ae57 admin admin] PATH_INFO: `/v3/users/acba502da4224b0d9c4c6f21274a3f28` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:45.678137 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43e5a0-4c3f-4f21-b9be-af295fe4ae57 admin admin] RBAC: Authorizing `identity:get_user(user_id=acba502da4224b0d9c4c6f21274a3f28)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:45.680322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43e5a0-4c3f-4f21-b9be-af295fe4ae57 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:45.682063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 514/1010] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:25:45 2021] GET /identity/v3/users/acba502da4224b0d9c4c6f21274a3f28 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:45.688660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d1722-da3d-493c-baea-7d9ece5db8b6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:45.698673 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d1722-da3d-493c-baea-7d9ece5db8b6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:45.703282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500c2c8-0729-4e68-9ca4-becae3bb09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:45.703917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500c2c8-0729-4e68-9ca4-becae3bb09ba admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:45.704205 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500c2c8-0729-4e68-9ca4-becae3bb09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:45.704519 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500c2c8-0729-4e68-9ca4-becae3bb09ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:45.713062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500c2c8-0729-4e68-9ca4-becae3bb09ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:45.714824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500c2c8-0729-4e68-9ca4-becae3bb09ba admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:45.723860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 497/1011] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:45 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:45.732194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43e5a0-4c3f-4f21-b9be-af295fe4ae57 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:45.742187 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43e5a0-4c3f-4f21-b9be-af295fe4ae57 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:45.746785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396df8fe-cbc9-4840-ae45-00ce3d47482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:45.747633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df8fe-cbc9-4840-ae45-00ce3d47482c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:45.747960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df8fe-cbc9-4840-ae45-00ce3d47482c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:45.748239 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df8fe-cbc9-4840-ae45-00ce3d47482c admin admin] PATH_INFO: `/v3/projects/433caccd464c42a085d7cc59c146af8c` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:45.749449 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396df8fe-cbc9-4840-ae45-00ce3d47482c admin admin] RBAC: Authorizing `identity:get_project(project_id=433caccd464c42a085d7cc59c146af8c)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:45.751536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396df8fe-cbc9-4840-ae45-00ce3d47482c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:45.753235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 515/1012] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:25:45 2021] GET /identity/v3/projects/433caccd464c42a085d7cc59c146af8c => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:45.760224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500c2c8-0729-4e68-9ca4-becae3bb09ba admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:45.768982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500c2c8-0729-4e68-9ca4-becae3bb09ba admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:45.774541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d7341-b34e-4d9f-a2e5-7d237d8bb851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:45.775214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d7341-b34e-4d9f-a2e5-7d237d8bb851 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:45.775567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d7341-b34e-4d9f-a2e5-7d237d8bb851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:45.775849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d7341-b34e-4d9f-a2e5-7d237d8bb851 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:45.776817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d7341-b34e-4d9f-a2e5-7d237d8bb851 admin admin] RBAC: Adding query filter params (role.id=3df7162472e345bd91ce9469ee6fe3f5, scope.project.id=433caccd464c42a085d7cc59c146af8c, user.id=acba502da4224b0d9c4c6f21274a3f28) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:45.777168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d7341-b34e-4d9f-a2e5-7d237d8bb851 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:45.779149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d7341-b34e-4d9f-a2e5-7d237d8bb851 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:45.784992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 498/1013] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:45 2021] GET /identity/v3/role_assignments?user.id=acba502da4224b0d9c4c6f21274a3f28&scope.project.id=433caccd464c42a085d7cc59c146af8c&role.id=3df7162472e345bd91ce9469ee6fe3f5 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:47.979507 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0957d4c-3991-4165-9044-e501eab38bf3 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:47.980042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0957d4c-3991-4165-9044-e501eab38bf3 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:47.980042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0957d4c-3991-4165-9044-e501eab38bf3 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:47.982211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 516/1014] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:47.988612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fae7f-02f5-4631-b703-45b588876194 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:47.989101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fae7f-02f5-4631-b703-45b588876194 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:47.989196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fae7f-02f5-4631-b703-45b588876194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:48.008011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-548fae7f-02f5-4631-b703-45b588876194 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:48.009243 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-548fae7f-02f5-4631-b703-45b588876194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:48.016879 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 499/1015] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:48.044104 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0957d4c-3991-4165-9044-e501eab38bf3 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:48.057276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0957d4c-3991-4165-9044-e501eab38bf3 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:48.061756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9241da-6bb9-405e-b219-d3b0bcac794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:48.062606 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9241da-6bb9-405e-b219-d3b0bcac794b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:48.062956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9241da-6bb9-405e-b219-d3b0bcac794b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:48.063240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9241da-6bb9-405e-b219-d3b0bcac794b admin admin] PATH_INFO: `/v3/roles/3df7162472e345bd91ce9469ee6fe3f5` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:48.064727 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9241da-6bb9-405e-b219-d3b0bcac794b admin admin] RBAC: Authorizing `identity:get_role(role_id=3df7162472e345bd91ce9469ee6fe3f5)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:48.065774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-ca9241da-6bb9-405e-b219-d3b0bcac794b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:48.065774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:25:48.065774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:25:48.066657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9241da-6bb9-405e-b219-d3b0bcac794b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:48.068016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 517/1016] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:25:48 2021] GET /identity/v3/roles/3df7162472e345bd91ce9469ee6fe3f5 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:48.074757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fae7f-02f5-4631-b703-45b588876194 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:48.083713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fae7f-02f5-4631-b703-45b588876194 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:48.088188 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b192f5-bb2e-49e4-a75c-cfe1b375e032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:48.089062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b192f5-bb2e-49e4-a75c-cfe1b375e032 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:48.089341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b192f5-bb2e-49e4-a75c-cfe1b375e032 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:48.089610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b192f5-bb2e-49e4-a75c-cfe1b375e032 admin admin] PATH_INFO: `/v3/users/acba502da4224b0d9c4c6f21274a3f28` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:48.090775 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b192f5-bb2e-49e4-a75c-cfe1b375e032 admin admin] RBAC: Authorizing `identity:get_user(user_id=acba502da4224b0d9c4c6f21274a3f28)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:48.092932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b192f5-bb2e-49e4-a75c-cfe1b375e032 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:48.094497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 500/1017] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:25:48 2021] GET /identity/v3/users/acba502da4224b0d9c4c6f21274a3f28 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:48.101427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9241da-6bb9-405e-b219-d3b0bcac794b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:48.111837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9241da-6bb9-405e-b219-d3b0bcac794b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:48.117119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97695c38-7496-4c0b-9118-a8d3b4d256bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:48.117955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97695c38-7496-4c0b-9118-a8d3b4d256bc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:48.118238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97695c38-7496-4c0b-9118-a8d3b4d256bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:48.118511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97695c38-7496-4c0b-9118-a8d3b4d256bc admin admin] PATH_INFO: `/v3/projects/433caccd464c42a085d7cc59c146af8c` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:48.119714 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97695c38-7496-4c0b-9118-a8d3b4d256bc admin admin] RBAC: Authorizing `identity:get_project(project_id=433caccd464c42a085d7cc59c146af8c)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:48.121792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97695c38-7496-4c0b-9118-a8d3b4d256bc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:48.123421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 518/1018] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:25:48 2021] GET /identity/v3/projects/433caccd464c42a085d7cc59c146af8c => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:48.129910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b192f5-bb2e-49e4-a75c-cfe1b375e032 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:48.139333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b192f5-bb2e-49e4-a75c-cfe1b375e032 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:48.143821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20525f-430f-4115-9a82-f1f6d781f00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:48.144709 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20525f-430f-4115-9a82-f1f6d781f00e admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:48.144994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20525f-430f-4115-9a82-f1f6d781f00e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:48.145267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20525f-430f-4115-9a82-f1f6d781f00e admin admin] PATH_INFO: `/v3/projects/433caccd464c42a085d7cc59c146af8c/users/acba502da4224b0d9c4c6f21274a3f28/roles/3df7162472e345bd91ce9469ee6fe3f5` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:48.147419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20525f-430f-4115-9a82-f1f6d781f00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=433caccd464c42a085d7cc59c146af8c, user_id=acba502da4224b0d9c4c6f21274a3f28, role_id=3df7162472e345bd91ce9469ee6fe3f5)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:48.150096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20525f-430f-4115-9a82-f1f6d781f00e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:48.367580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 501/1019] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:25:48 2021] PUT /identity/v3/projects/433caccd464c42a085d7cc59c146af8c/users/acba502da4224b0d9c4c6f21274a3f28/roles/3df7162472e345bd91ce9469ee6fe3f5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:25:50.487171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a728abc-3bce-482c-9c18-ff0f904e89aa None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:50.487778 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a728abc-3bce-482c-9c18-ff0f904e89aa None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:50.488140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a728abc-3bce-482c-9c18-ff0f904e89aa None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:50.491526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 519/1020] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:50 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:50.498136 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e6e53-2de5-4627-98c4-56526bf8e02a None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:50.498680 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e6e53-2de5-4627-98c4-56526bf8e02a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:50.498680 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e6e53-2de5-4627-98c4-56526bf8e02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:50.518918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e16e6e53-2de5-4627-98c4-56526bf8e02a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:50.520130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e16e6e53-2de5-4627-98c4-56526bf8e02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:50.581748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 502/1021] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:50.607554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a728abc-3bce-482c-9c18-ff0f904e89aa None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:50.620169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a728abc-3bce-482c-9c18-ff0f904e89aa None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:50.624825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56082d2-8a02-4be1-9ceb-8633614a6839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:50.625684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56082d2-8a02-4be1-9ceb-8633614a6839 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:50.625967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56082d2-8a02-4be1-9ceb-8633614a6839 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:50.626238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56082d2-8a02-4be1-9ceb-8633614a6839 admin admin] PATH_INFO: `/v3/roles/3df7162472e345bd91ce9469ee6fe3f5` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:50.627766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56082d2-8a02-4be1-9ceb-8633614a6839 admin admin] RBAC: Authorizing `identity:get_role(role_id=3df7162472e345bd91ce9469ee6fe3f5)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:50.629409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56082d2-8a02-4be1-9ceb-8633614a6839 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:50.630794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 520/1022] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:25:50 2021] GET /identity/v3/roles/3df7162472e345bd91ce9469ee6fe3f5 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:50.637973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e6e53-2de5-4627-98c4-56526bf8e02a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:50.647791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e6e53-2de5-4627-98c4-56526bf8e02a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:50.655540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440eafe-fa37-4e05-8f98-b04111645933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:50.656453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440eafe-fa37-4e05-8f98-b04111645933 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:50.656735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440eafe-fa37-4e05-8f98-b04111645933 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:50.657013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440eafe-fa37-4e05-8f98-b04111645933 admin admin] PATH_INFO: `/v3/users/acba502da4224b0d9c4c6f21274a3f28` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:50.658245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440eafe-fa37-4e05-8f98-b04111645933 admin admin] RBAC: Authorizing `identity:get_user(user_id=acba502da4224b0d9c4c6f21274a3f28)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:50.660459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440eafe-fa37-4e05-8f98-b04111645933 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:50.662136 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 503/1023] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:25:50 2021] GET /identity/v3/users/acba502da4224b0d9c4c6f21274a3f28 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:50.669186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56082d2-8a02-4be1-9ceb-8633614a6839 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:50.680219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56082d2-8a02-4be1-9ceb-8633614a6839 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:50.684992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9d298-fdb6-4787-948e-e3d4c61ac864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:50.685653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9d298-fdb6-4787-948e-e3d4c61ac864 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:50.685939 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9d298-fdb6-4787-948e-e3d4c61ac864 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:50.686220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9d298-fdb6-4787-948e-e3d4c61ac864 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:50.699163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9d298-fdb6-4787-948e-e3d4c61ac864 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:50.699163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9d298-fdb6-4787-948e-e3d4c61ac864 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:50.707505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 521/1024] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:50 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:50.714468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440eafe-fa37-4e05-8f98-b04111645933 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:50.724380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440eafe-fa37-4e05-8f98-b04111645933 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:50.729268 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950e27c-f4f4-473c-a60a-e61e8a0cb280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:50.730128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950e27c-f4f4-473c-a60a-e61e8a0cb280 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:50.730410 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950e27c-f4f4-473c-a60a-e61e8a0cb280 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:50.730687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950e27c-f4f4-473c-a60a-e61e8a0cb280 admin admin] PATH_INFO: `/v3/projects/433caccd464c42a085d7cc59c146af8c` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:50.731952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950e27c-f4f4-473c-a60a-e61e8a0cb280 admin admin] RBAC: Authorizing `identity:get_project(project_id=433caccd464c42a085d7cc59c146af8c)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:50.734067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950e27c-f4f4-473c-a60a-e61e8a0cb280 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:50.735827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 504/1025] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:25:50 2021] GET /identity/v3/projects/433caccd464c42a085d7cc59c146af8c => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:50.743677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9d298-fdb6-4787-948e-e3d4c61ac864 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:50.752852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9d298-fdb6-4787-948e-e3d4c61ac864 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:50.758699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f2b1d-e3d6-4861-a73c-746662e21f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:50.759838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2b1d-e3d6-4861-a73c-746662e21f70 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:50.760319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2b1d-e3d6-4861-a73c-746662e21f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:50.760833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2b1d-e3d6-4861-a73c-746662e21f70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:50.762390 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f2b1d-e3d6-4861-a73c-746662e21f70 admin admin] RBAC: Adding query filter params (role.id=3df7162472e345bd91ce9469ee6fe3f5, scope.project.id=433caccd464c42a085d7cc59c146af8c, user.id=acba502da4224b0d9c4c6f21274a3f28) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:50.762924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f2b1d-e3d6-4861-a73c-746662e21f70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:50.765838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f2b1d-e3d6-4861-a73c-746662e21f70 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:50.774201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 522/1026] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:50 2021] GET /identity/v3/role_assignments?user.id=acba502da4224b0d9c4c6f21274a3f28&scope.project.id=433caccd464c42a085d7cc59c146af8c&role.id=3df7162472e345bd91ce9469ee6fe3f5 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:52.987911 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72712cf3-f92c-493d-904b-e3eec3a7c485 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:52.988694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72712cf3-f92c-493d-904b-e3eec3a7c485 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:52.988694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72712cf3-f92c-493d-904b-e3eec3a7c485 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:52.990192 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 505/1027] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:52.996623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245136-61ca-4fef-885e-6aef7a5f5a5f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:52.997154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245136-61ca-4fef-885e-6aef7a5f5a5f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:52.997154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245136-61ca-4fef-885e-6aef7a5f5a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:53.014780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-50245136-61ca-4fef-885e-6aef7a5f5a5f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:53.015997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-50245136-61ca-4fef-885e-6aef7a5f5a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:53.024402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 523/1028] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:53.050196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72712cf3-f92c-493d-904b-e3eec3a7c485 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:53.062972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72712cf3-f92c-493d-904b-e3eec3a7c485 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:53.067488 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d93505-dde5-48e5-b459-707515f9a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:53.068271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93505-dde5-48e5-b459-707515f9a1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:53.068581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93505-dde5-48e5-b459-707515f9a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:53.068858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93505-dde5-48e5-b459-707515f9a1b7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:53.070032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d93505-dde5-48e5-b459-707515f9a1b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:53.071739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d93505-dde5-48e5-b459-707515f9a1b7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:53.073393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 506/1029] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:53.080195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245136-61ca-4fef-885e-6aef7a5f5a5f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:53.089816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245136-61ca-4fef-885e-6aef7a5f5a5f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:53.094538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f4ffe-4620-4930-bc8c-1018e9527362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:53.095205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4ffe-4620-4930-bc8c-1018e9527362 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:53.095489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4ffe-4620-4930-bc8c-1018e9527362 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:53.095800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4ffe-4620-4930-bc8c-1018e9527362 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:53.096565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f4ffe-4620-4930-bc8c-1018e9527362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:53.098512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f4ffe-4620-4930-bc8c-1018e9527362 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:53.207583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 524/1030] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:25:53 2021] POST /identity/v3/projects => generated 311 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:55.382929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2111cd-d01d-489e-b5fb-77b043580311 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:55.383618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2111cd-d01d-489e-b5fb-77b043580311 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:55.383618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2111cd-d01d-489e-b5fb-77b043580311 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:55.385280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 507/1031] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:55.391288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc366f31-86f8-4bca-a63f-cf553043ce27 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:55.391683 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc366f31-86f8-4bca-a63f-cf553043ce27 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:55.391842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc366f31-86f8-4bca-a63f-cf553043ce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:55.414649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-bc366f31-86f8-4bca-a63f-cf553043ce27 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:55.415825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-bc366f31-86f8-4bca-a63f-cf553043ce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:55.471036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 525/1032] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:55.497050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2111cd-d01d-489e-b5fb-77b043580311 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:55.509146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2111cd-d01d-489e-b5fb-77b043580311 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:55.513527 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bbdb8-7315-4c82-89fc-16188798f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:55.514291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bbdb8-7315-4c82-89fc-16188798f92d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:55.514572 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bbdb8-7315-4c82-89fc-16188798f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:55.514846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bbdb8-7315-4c82-89fc-16188798f92d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:55.516013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bbdb8-7315-4c82-89fc-16188798f92d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:55.517741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bbdb8-7315-4c82-89fc-16188798f92d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:55.519303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 508/1033] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:25:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:25:55.526319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc366f31-86f8-4bca-a63f-cf553043ce27 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:55.535568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc366f31-86f8-4bca-a63f-cf553043ce27 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:55.540999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec830ec-16d4-48ca-be4c-ab813478983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:55.541681 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec830ec-16d4-48ca-be4c-ab813478983a admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:55.541967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec830ec-16d4-48ca-be4c-ab813478983a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:55.542499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec830ec-16d4-48ca-be4c-ab813478983a admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:55.543216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec830ec-16d4-48ca-be4c-ab813478983a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:55.545220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec830ec-16d4-48ca-be4c-ab813478983a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:55.818305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 526/1034] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:25:55 2021] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:25:58.049614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180e0a-8baa-4087-9d09-3a08adb924dc None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:58.050157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180e0a-8baa-4087-9d09-3a08adb924dc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:58.050157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180e0a-8baa-4087-9d09-3a08adb924dc None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:58.051840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 509/1035] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:25:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:25:58.058546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6b7c-bfaf-4019-aaf9-e966ab2952ec None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:58.058955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6b7c-bfaf-4019-aaf9-e966ab2952ec None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:58.059141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6b7c-bfaf-4019-aaf9-e966ab2952ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:58.076969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ef4c6b7c-bfaf-4019-aaf9-e966ab2952ec None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:25:58.078216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ef4c6b7c-bfaf-4019-aaf9-e966ab2952ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:58.086133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 527/1036] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:25:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:25:58.110782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02180e0a-8baa-4087-9d09-3a08adb924dc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:58.123326 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02180e0a-8baa-4087-9d09-3a08adb924dc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:58.127707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c4fb9-31b2-40f0-9a2c-dd328156c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:58.128499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c4fb9-31b2-40f0-9a2c-dd328156c851 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:58.128788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c4fb9-31b2-40f0-9a2c-dd328156c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:58.129065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c4fb9-31b2-40f0-9a2c-dd328156c851 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:58.139779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c4fb9-31b2-40f0-9a2c-dd328156c851 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:25:58.146532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-d02c4fb9-31b2-40f0-9a2c-dd328156c851 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:25:58.148304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 510/1037] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:25:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:25:58.155351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6b7c-bfaf-4019-aaf9-e966ab2952ec None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:58.165113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6b7c-bfaf-4019-aaf9-e966ab2952ec None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:58.169881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5a818-02b0-4675-b3a4-11973994532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:58.170529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5a818-02b0-4675-b3a4-11973994532a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:58.170808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5a818-02b0-4675-b3a4-11973994532a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:58.171078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5a818-02b0-4675-b3a4-11973994532a admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:58.171818 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5a818-02b0-4675-b3a4-11973994532a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:58.172111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5a818-02b0-4675-b3a4-11973994532a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:58.173722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5a818-02b0-4675-b3a4-11973994532a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:58.181880 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 528/1038] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:25:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:58.188121 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c4fb9-31b2-40f0-9a2c-dd328156c851 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:58.198201 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c4fb9-31b2-40f0-9a2c-dd328156c851 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:58.202722 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3538439-496e-4b49-aeb4-12088152054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:58.203552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3538439-496e-4b49-aeb4-12088152054e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:58.203833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3538439-496e-4b49-aeb4-12088152054e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:58.204109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3538439-496e-4b49-aeb4-12088152054e admin admin] PATH_INFO: `/v3/users/5805367ebb924e8a9239816068e327b2` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:58.217593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3538439-496e-4b49-aeb4-12088152054e admin admin] RBAC: Authorizing `identity:get_user(user_id=5805367ebb924e8a9239816068e327b2)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:58.219740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3538439-496e-4b49-aeb4-12088152054e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:58.221398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 511/1039] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:25:58 2021] GET /identity/v3/users/5805367ebb924e8a9239816068e327b2 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:58.228371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5a818-02b0-4675-b3a4-11973994532a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:58.237749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5a818-02b0-4675-b3a4-11973994532a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:58.242359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ec2a4-6a58-454d-8a32-13a52c927613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:58.242984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ec2a4-6a58-454d-8a32-13a52c927613 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:58.243262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ec2a4-6a58-454d-8a32-13a52c927613 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:58.243534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ec2a4-6a58-454d-8a32-13a52c927613 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:58.251482 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ec2a4-6a58-454d-8a32-13a52c927613 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:58.253268 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ec2a4-6a58-454d-8a32-13a52c927613 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:58.261969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 529/1040] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:25:58 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:25:58.268533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3538439-496e-4b49-aeb4-12088152054e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:58.278647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3538439-496e-4b49-aeb4-12088152054e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:58.283193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9d6b3-3854-4179-ab9b-9bf0cd867442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:58.284029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d6b3-3854-4179-ab9b-9bf0cd867442 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:58.284308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d6b3-3854-4179-ab9b-9bf0cd867442 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:58.284613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d6b3-3854-4179-ab9b-9bf0cd867442 admin admin] PATH_INFO: `/v3/projects/284a746657ea43e294ce0896f49bd3a6` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:58.285773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9d6b3-3854-4179-ab9b-9bf0cd867442 admin admin] RBAC: Authorizing `identity:get_project(project_id=284a746657ea43e294ce0896f49bd3a6)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:58.288497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9d6b3-3854-4179-ab9b-9bf0cd867442 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:58.290135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 512/1041] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:25:58 2021] GET /identity/v3/projects/284a746657ea43e294ce0896f49bd3a6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:25:58.296957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ec2a4-6a58-454d-8a32-13a52c927613 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:58.305741 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ec2a4-6a58-454d-8a32-13a52c927613 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:58.310183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb7c12-d6e7-4528-bde7-a7b935295227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:58.310809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb7c12-d6e7-4528-bde7-a7b935295227 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:58.311086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb7c12-d6e7-4528-bde7-a7b935295227 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:58.311353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb7c12-d6e7-4528-bde7-a7b935295227 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:58.312161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb7c12-d6e7-4528-bde7-a7b935295227 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=284a746657ea43e294ce0896f49bd3a6, user.id=5805367ebb924e8a9239816068e327b2) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:25:58.312494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb7c12-d6e7-4528-bde7-a7b935295227 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:58.314348 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb7c12-d6e7-4528-bde7-a7b935295227 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:58.319636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 530/1042] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:25:58 2021] GET /identity/v3/role_assignments?user.id=5805367ebb924e8a9239816068e327b2&scope.project.id=284a746657ea43e294ce0896f49bd3a6&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:00.484232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf16f6-8937-42c6-b6f8-0c951b674211 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:00.484811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf16f6-8937-42c6-b6f8-0c951b674211 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:00.484811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf16f6-8937-42c6-b6f8-0c951b674211 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:00.486892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 513/1043] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:26:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:26:00.494306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9a8d-9b82-4dd1-81c8-c167e449bbb2 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:00.494862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9a8d-9b82-4dd1-81c8-c167e449bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:00.494862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9a8d-9b82-4dd1-81c8-c167e449bbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:00.513210 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-6c4c9a8d-9b82-4dd1-81c8-c167e449bbb2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:26:00.514397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6c4c9a8d-9b82-4dd1-81c8-c167e449bbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:00.522510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 531/1044] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:26:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:26:00.547339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf16f6-8937-42c6-b6f8-0c951b674211 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:00.559675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf16f6-8937-42c6-b6f8-0c951b674211 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:00.564161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd12f85-9657-46d7-b16b-f0cf8577ff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:00.565061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd12f85-9657-46d7-b16b-f0cf8577ff69 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:00.565341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd12f85-9657-46d7-b16b-f0cf8577ff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:00.565617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd12f85-9657-46d7-b16b-f0cf8577ff69 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:00.576090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd12f85-9657-46d7-b16b-f0cf8577ff69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:26:00.583147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-fcd12f85-9657-46d7-b16b-f0cf8577ff69 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:26:00.584889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 514/1045] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:26:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:26:00.591997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c9a8d-9b82-4dd1-81c8-c167e449bbb2 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:00.601799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c9a8d-9b82-4dd1-81c8-c167e449bbb2 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:00.606414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce88f2-a9e6-428f-9e4e-1159df50f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:00.607069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce88f2-a9e6-428f-9e4e-1159df50f9fc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:00.607352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce88f2-a9e6-428f-9e4e-1159df50f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:00.607626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce88f2-a9e6-428f-9e4e-1159df50f9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:00.608389 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce88f2-a9e6-428f-9e4e-1159df50f9fc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:26:00.608699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce88f2-a9e6-428f-9e4e-1159df50f9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:00.610307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce88f2-a9e6-428f-9e4e-1159df50f9fc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:00.618524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 532/1046] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:26:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:00.625048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd12f85-9657-46d7-b16b-f0cf8577ff69 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:00.635433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd12f85-9657-46d7-b16b-f0cf8577ff69 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:00.640077 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e238c15-b61d-441f-97ca-f3372885fb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:00.640953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e238c15-b61d-441f-97ca-f3372885fb81 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:00.641234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e238c15-b61d-441f-97ca-f3372885fb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:00.641505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e238c15-b61d-441f-97ca-f3372885fb81 admin admin] PATH_INFO: `/v3/users/5805367ebb924e8a9239816068e327b2` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:00.642706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e238c15-b61d-441f-97ca-f3372885fb81 admin admin] RBAC: Authorizing `identity:get_user(user_id=5805367ebb924e8a9239816068e327b2)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:00.644957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e238c15-b61d-441f-97ca-f3372885fb81 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:00.646550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 515/1047] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:26:00 2021] GET /identity/v3/users/5805367ebb924e8a9239816068e327b2 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:00.653433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce88f2-a9e6-428f-9e4e-1159df50f9fc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:00.663863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce88f2-a9e6-428f-9e4e-1159df50f9fc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:00.668809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fac6a7-d640-42ea-842e-eb654b0a0373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:00.669663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fac6a7-d640-42ea-842e-eb654b0a0373 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:00.669948 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fac6a7-d640-42ea-842e-eb654b0a0373 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:00.670228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fac6a7-d640-42ea-842e-eb654b0a0373 admin admin] PATH_INFO: `/v3/projects/284a746657ea43e294ce0896f49bd3a6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:00.671411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fac6a7-d640-42ea-842e-eb654b0a0373 admin admin] RBAC: Authorizing `identity:get_project(project_id=284a746657ea43e294ce0896f49bd3a6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:00.673506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fac6a7-d640-42ea-842e-eb654b0a0373 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:00.675190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 533/1048] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:26:00 2021] GET /identity/v3/projects/284a746657ea43e294ce0896f49bd3a6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:00.681928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e238c15-b61d-441f-97ca-f3372885fb81 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:00.692185 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e238c15-b61d-441f-97ca-f3372885fb81 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:00.697116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136e3fd-a996-4c7c-94dd-d1eea62881ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:00.698032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136e3fd-a996-4c7c-94dd-d1eea62881ae admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:00.698330 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136e3fd-a996-4c7c-94dd-d1eea62881ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:00.698624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136e3fd-a996-4c7c-94dd-d1eea62881ae admin admin] PATH_INFO: `/v3/projects/284a746657ea43e294ce0896f49bd3a6/users/5805367ebb924e8a9239816068e327b2/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:00.700693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136e3fd-a996-4c7c-94dd-d1eea62881ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=284a746657ea43e294ce0896f49bd3a6, user_id=5805367ebb924e8a9239816068e327b2, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:00.703441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136e3fd-a996-4c7c-94dd-d1eea62881ae admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:00.805673 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 516/1049] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:26:00 2021] PUT /identity/v3/projects/284a746657ea43e294ce0896f49bd3a6/users/5805367ebb924e8a9239816068e327b2/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:26:03.020875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191e2d-86d9-4463-86b7-fa2e6fd4f887 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:03.021432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191e2d-86d9-4463-86b7-fa2e6fd4f887 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:03.021432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191e2d-86d9-4463-86b7-fa2e6fd4f887 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:03.023125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 534/1050] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:26:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:26:03.029804 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a0795-119d-446b-a495-73fae85ac326 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:03.030327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a0795-119d-446b-a495-73fae85ac326 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:03.030327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a0795-119d-446b-a495-73fae85ac326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:03.049429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-380a0795-119d-446b-a495-73fae85ac326 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:26:03.050692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-380a0795-119d-446b-a495-73fae85ac326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:03.108127 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 517/1051] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:26:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:26:03.133173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191e2d-86d9-4463-86b7-fa2e6fd4f887 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:03.145271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191e2d-86d9-4463-86b7-fa2e6fd4f887 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:03.149557 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4a22d-7297-401b-ab83-1dc426766769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:03.150334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4a22d-7297-401b-ab83-1dc426766769 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:03.150611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4a22d-7297-401b-ab83-1dc426766769 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:03.150881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4a22d-7297-401b-ab83-1dc426766769 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:03.161365 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4a22d-7297-401b-ab83-1dc426766769 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:26:03.168776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-13d4a22d-7297-401b-ab83-1dc426766769 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:26:03.169982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 535/1052] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:26:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:26:03.176806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a0795-119d-446b-a495-73fae85ac326 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:03.186719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a0795-119d-446b-a495-73fae85ac326 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:03.191271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae69de-9856-402f-94f6-13b867f2c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:03.191934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae69de-9856-402f-94f6-13b867f2c9db admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:03.192220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae69de-9856-402f-94f6-13b867f2c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:03.192528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae69de-9856-402f-94f6-13b867f2c9db admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:03.193289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae69de-9856-402f-94f6-13b867f2c9db admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:26:03.193600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae69de-9856-402f-94f6-13b867f2c9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:03.195207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae69de-9856-402f-94f6-13b867f2c9db admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:03.203854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 518/1053] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:26:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:03.210581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4a22d-7297-401b-ab83-1dc426766769 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:03.220970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4a22d-7297-401b-ab83-1dc426766769 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:03.226086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75aa5c-e6f9-46e5-9b2c-094136fc413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:03.226938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75aa5c-e6f9-46e5-9b2c-094136fc413b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:03.227216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75aa5c-e6f9-46e5-9b2c-094136fc413b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:03.227488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75aa5c-e6f9-46e5-9b2c-094136fc413b admin admin] PATH_INFO: `/v3/users/5805367ebb924e8a9239816068e327b2` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:03.228711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75aa5c-e6f9-46e5-9b2c-094136fc413b admin admin] RBAC: Authorizing `identity:get_user(user_id=5805367ebb924e8a9239816068e327b2)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:03.230878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75aa5c-e6f9-46e5-9b2c-094136fc413b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:03.232517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 536/1054] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:26:03 2021] GET /identity/v3/users/5805367ebb924e8a9239816068e327b2 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:26:03.239580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae69de-9856-402f-94f6-13b867f2c9db admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:03.249921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae69de-9856-402f-94f6-13b867f2c9db admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:03.254436 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90ce76-b3af-43ad-8332-a9a2aa963cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:03.255101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90ce76-b3af-43ad-8332-a9a2aa963cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:03.255384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90ce76-b3af-43ad-8332-a9a2aa963cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:03.255655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90ce76-b3af-43ad-8332-a9a2aa963cb2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:03.263569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90ce76-b3af-43ad-8332-a9a2aa963cb2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:03.265426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90ce76-b3af-43ad-8332-a9a2aa963cb2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:03.274191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 519/1055] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:26:03 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:26:03.281113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75aa5c-e6f9-46e5-9b2c-094136fc413b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:03.291262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75aa5c-e6f9-46e5-9b2c-094136fc413b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:03.296158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2833e3e-b3d3-47ee-a4b7-39a9daa647c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:03.297022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2833e3e-b3d3-47ee-a4b7-39a9daa647c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:03.297307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2833e3e-b3d3-47ee-a4b7-39a9daa647c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:03.297584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2833e3e-b3d3-47ee-a4b7-39a9daa647c9 admin admin] PATH_INFO: `/v3/projects/284a746657ea43e294ce0896f49bd3a6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:03.298749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2833e3e-b3d3-47ee-a4b7-39a9daa647c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=284a746657ea43e294ce0896f49bd3a6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:03.300889 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2833e3e-b3d3-47ee-a4b7-39a9daa647c9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:03.302577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 537/1056] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:26:03 2021] GET /identity/v3/projects/284a746657ea43e294ce0896f49bd3a6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:03.309853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90ce76-b3af-43ad-8332-a9a2aa963cb2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:03.318446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90ce76-b3af-43ad-8332-a9a2aa963cb2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:03.322932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad312f-4973-4570-ac8c-99cd6a595e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:03.323552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad312f-4973-4570-ac8c-99cd6a595e07 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:03.323831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad312f-4973-4570-ac8c-99cd6a595e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:03.324097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad312f-4973-4570-ac8c-99cd6a595e07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:03.324955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad312f-4973-4570-ac8c-99cd6a595e07 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=284a746657ea43e294ce0896f49bd3a6, user.id=5805367ebb924e8a9239816068e327b2) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:26:03.325261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad312f-4973-4570-ac8c-99cd6a595e07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:03.327078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad312f-4973-4570-ac8c-99cd6a595e07 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:03.332877 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 520/1057] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:26:03 2021] GET /identity/v3/role_assignments?user.id=5805367ebb924e8a9239816068e327b2&scope.project.id=284a746657ea43e294ce0896f49bd3a6&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:05.532374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1495f-ed63-45cc-ae15-109d62160991 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:05.532903 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1495f-ed63-45cc-ae15-109d62160991 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:05.533014 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1495f-ed63-45cc-ae15-109d62160991 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:05.534691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 538/1058] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:26:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:26:05.540970 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38351dc9-4c56-4bb8-9d00-9d70dc7aa9e8 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:05.541382 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38351dc9-4c56-4bb8-9d00-9d70dc7aa9e8 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:05.541528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38351dc9-4c56-4bb8-9d00-9d70dc7aa9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:05.559485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-38351dc9-4c56-4bb8-9d00-9d70dc7aa9e8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:26:05.560711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-38351dc9-4c56-4bb8-9d00-9d70dc7aa9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:05.568919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 521/1059] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:26:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:26:05.593144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1495f-ed63-45cc-ae15-109d62160991 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:05.605885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1495f-ed63-45cc-ae15-109d62160991 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:05.610401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992195-3538-453f-8e37-cfe2c08ff7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:05.611039 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992195-3538-453f-8e37-cfe2c08ff7bf admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:05.611326 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992195-3538-453f-8e37-cfe2c08ff7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:05.611640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992195-3538-453f-8e37-cfe2c08ff7bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:05.619659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87992195-3538-453f-8e37-cfe2c08ff7bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:05.621448 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87992195-3538-453f-8e37-cfe2c08ff7bf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:05.630668 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 539/1060] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:26:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:26:05.638036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38351dc9-4c56-4bb8-9d00-9d70dc7aa9e8 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:05.648439 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38351dc9-4c56-4bb8-9d00-9d70dc7aa9e8 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:05.653191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f564dfe-2512-4db4-95a3-9cb521507baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:05.653992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564dfe-2512-4db4-95a3-9cb521507baa admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:05.654271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564dfe-2512-4db4-95a3-9cb521507baa admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:05.654541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564dfe-2512-4db4-95a3-9cb521507baa admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:05.662117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f564dfe-2512-4db4-95a3-9cb521507baa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:05.664016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f564dfe-2512-4db4-95a3-9cb521507baa admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:05.679545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-7f564dfe-2512-4db4-95a3-9cb521507baa admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 27 04:26:05.680886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 522/1061] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 04:26:05 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:26:05.687858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992195-3538-453f-8e37-cfe2c08ff7bf admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:05.697946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992195-3538-453f-8e37-cfe2c08ff7bf admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:05.702738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e66ef-a7a4-42c0-bb04-dfd4b5215b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:05.703411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e66ef-a7a4-42c0-bb04-dfd4b5215b9a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:05.703692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e66ef-a7a4-42c0-bb04-dfd4b5215b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:05.703970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e66ef-a7a4-42c0-bb04-dfd4b5215b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:05.704742 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e66ef-a7a4-42c0-bb04-dfd4b5215b9a admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:26:05.705054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e66ef-a7a4-42c0-bb04-dfd4b5215b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:05.706655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e66ef-a7a4-42c0-bb04-dfd4b5215b9a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:05.715924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 540/1062] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 04:26:05 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:07.856747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39515e2-8f73-4fd6-a9da-352f3f17fdec None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:07.857264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39515e2-8f73-4fd6-a9da-352f3f17fdec None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:07.857352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39515e2-8f73-4fd6-a9da-352f3f17fdec None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:07.859077 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 523/1063] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:26:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:26:07.865041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42c96-fc22-4e2c-abdd-783ecae507c0 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:07.865521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42c96-fc22-4e2c-abdd-783ecae507c0 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:07.865613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42c96-fc22-4e2c-abdd-783ecae507c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:07.884121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-34e42c96-fc22-4e2c-abdd-783ecae507c0 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:26:07.885351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-34e42c96-fc22-4e2c-abdd-783ecae507c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:07.893001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 541/1064] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:26:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:26:07.920346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39515e2-8f73-4fd6-a9da-352f3f17fdec None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:07.932858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39515e2-8f73-4fd6-a9da-352f3f17fdec None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:07.937462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405a379-4bbf-4ec8-8888-1a8616f56c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:07.938137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405a379-4bbf-4ec8-8888-1a8616f56c73 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:07.938419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405a379-4bbf-4ec8-8888-1a8616f56c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:07.938782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405a379-4bbf-4ec8-8888-1a8616f56c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:07.939670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405a379-4bbf-4ec8-8888-1a8616f56c73 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:07.940717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-0405a379-4bbf-4ec8-8888-1a8616f56c73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:26:07.940717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:26:07.940717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:26:07.941599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405a379-4bbf-4ec8-8888-1a8616f56c73 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:08.030887 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 524/1065] 10.222.0.25 () {60 vars in 1160 bytes} [Fri Aug 27 04:26:07 2021] POST /identity/v3/domains => generated 267 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:26:10.243123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967a213-8242-492b-bfba-4a10ce79ad0c None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:10.243666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967a213-8242-492b-bfba-4a10ce79ad0c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:10.243780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967a213-8242-492b-bfba-4a10ce79ad0c None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:10.245598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 542/1066] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:26:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:26:10.251812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f882-5370-4f06-9cf1-8d8990737453 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:10.252274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f882-5370-4f06-9cf1-8d8990737453 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:10.252398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f882-5370-4f06-9cf1-8d8990737453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:10.270521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-5f24f882-5370-4f06-9cf1-8d8990737453 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:26:10.271745 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5f24f882-5370-4f06-9cf1-8d8990737453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:10.329166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 525/1067] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:26:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:26:10.354293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967a213-8242-492b-bfba-4a10ce79ad0c None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:10.367080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967a213-8242-492b-bfba-4a10ce79ad0c None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:10.371576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175d3f2-7836-4be6-a4fa-4c1e4b1859fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:10.372458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175d3f2-7836-4be6-a4fa-4c1e4b1859fc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:10.372745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175d3f2-7836-4be6-a4fa-4c1e4b1859fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:10.373023 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175d3f2-7836-4be6-a4fa-4c1e4b1859fc admin admin] PATH_INFO: `/v3/domains/ff2bf692f15d48cfa12a0628e1018e63` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:10.384319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175d3f2-7836-4be6-a4fa-4c1e4b1859fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=ff2bf692f15d48cfa12a0628e1018e63)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:10.386323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175d3f2-7836-4be6-a4fa-4c1e4b1859fc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:10.388029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 543/1068] 10.222.0.25 () {56 vars in 1205 bytes} [Fri Aug 27 04:26:10 2021] GET /identity/v3/domains/ff2bf692f15d48cfa12a0628e1018e63 => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:10.394827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24f882-5370-4f06-9cf1-8d8990737453 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:10.403797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24f882-5370-4f06-9cf1-8d8990737453 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:10.408335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9b1f7-ed43-499a-98fb-cc4f1a06cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:10.409002 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9b1f7-ed43-499a-98fb-cc4f1a06cf89 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:10.409281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9b1f7-ed43-499a-98fb-cc4f1a06cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:10.409554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9b1f7-ed43-499a-98fb-cc4f1a06cf89 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:10.410259 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9b1f7-ed43-499a-98fb-cc4f1a06cf89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:10.412235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9b1f7-ed43-499a-98fb-cc4f1a06cf89 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:10.557305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 526/1069] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:26:10 2021] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:26:12.742405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765887a-3a2f-4a55-9987-7fffe03edecb None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:12.742956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765887a-3a2f-4a55-9987-7fffe03edecb None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:12.742956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765887a-3a2f-4a55-9987-7fffe03edecb None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:12.744715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 544/1070] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:26:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:26:12.750678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df54b-d93a-4a7e-bd4b-66353198046f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:12.751085 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df54b-d93a-4a7e-bd4b-66353198046f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:12.751239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df54b-d93a-4a7e-bd4b-66353198046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:12.768664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-890df54b-d93a-4a7e-bd4b-66353198046f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:26:12.769864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-890df54b-d93a-4a7e-bd4b-66353198046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:12.825749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 527/1071] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:26:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:26:12.852015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765887a-3a2f-4a55-9987-7fffe03edecb None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:12.864179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765887a-3a2f-4a55-9987-7fffe03edecb None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:12.868732 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46f018-0029-4036-a874-6b0eca5787ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:12.869573 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46f018-0029-4036-a874-6b0eca5787ca admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:12.869858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46f018-0029-4036-a874-6b0eca5787ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:12.870135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46f018-0029-4036-a874-6b0eca5787ca admin admin] PATH_INFO: `/v3/domains/ff2bf692f15d48cfa12a0628e1018e63` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:12.871297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46f018-0029-4036-a874-6b0eca5787ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=ff2bf692f15d48cfa12a0628e1018e63)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:12.873276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46f018-0029-4036-a874-6b0eca5787ca admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:12.874832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 545/1072] 10.222.0.25 () {56 vars in 1205 bytes} [Fri Aug 27 04:26:12 2021] GET /identity/v3/domains/ff2bf692f15d48cfa12a0628e1018e63 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:12.880916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890df54b-d93a-4a7e-bd4b-66353198046f None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:12.890153 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890df54b-d93a-4a7e-bd4b-66353198046f None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:12.894600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69063f-f612-4224-a8cc-533d9ca03b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:12.895245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69063f-f612-4224-a8cc-533d9ca03b57 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:12.895538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69063f-f612-4224-a8cc-533d9ca03b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:12.895819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69063f-f612-4224-a8cc-533d9ca03b57 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:12.896554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69063f-f612-4224-a8cc-533d9ca03b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:12.899056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69063f-f612-4224-a8cc-533d9ca03b57 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:12.983440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 528/1073] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:26:12 2021] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:26:15.158657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731ad8b-209a-43a5-9aa6-a05c7e467757 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:15.159300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731ad8b-209a-43a5-9aa6-a05c7e467757 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:15.159300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731ad8b-209a-43a5-9aa6-a05c7e467757 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:15.161024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 546/1074] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:26:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:26:15.167809 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6d5bb-4dd4-420a-8783-30eee4066933 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:15.168317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6d5bb-4dd4-420a-8783-30eee4066933 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:15.168481 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6d5bb-4dd4-420a-8783-30eee4066933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:15.186909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-a4a6d5bb-4dd4-420a-8783-30eee4066933 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:26:15.188131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a4a6d5bb-4dd4-420a-8783-30eee4066933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:15.196396 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 529/1075] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:26:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:26:15.221908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731ad8b-209a-43a5-9aa6-a05c7e467757 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:15.234372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731ad8b-209a-43a5-9aa6-a05c7e467757 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:15.238863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca15f2a-5cc7-4362-b85f-e556c5ee8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:15.239654 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca15f2a-5cc7-4362-b85f-e556c5ee8a1d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:15.239938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca15f2a-5cc7-4362-b85f-e556c5ee8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:15.240214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca15f2a-5cc7-4362-b85f-e556c5ee8a1d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:15.251585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca15f2a-5cc7-4362-b85f-e556c5ee8a1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:26:15.258919 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-5ca15f2a-5cc7-4362-b85f-e556c5ee8a1d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:26:15.260136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 547/1076] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:26:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:26:15.267451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6d5bb-4dd4-420a-8783-30eee4066933 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:15.277281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6d5bb-4dd4-420a-8783-30eee4066933 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:15.282010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0705d4-b58e-4136-965b-23c48422f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:15.282670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0705d4-b58e-4136-965b-23c48422f3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:15.282951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0705d4-b58e-4136-965b-23c48422f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:15.283226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0705d4-b58e-4136-965b-23c48422f3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:15.283970 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0705d4-b58e-4136-965b-23c48422f3b6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:26:15.284275 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0705d4-b58e-4136-965b-23c48422f3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:15.285918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0705d4-b58e-4136-965b-23c48422f3b6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:15.294800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 530/1077] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:26:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:15.301338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca15f2a-5cc7-4362-b85f-e556c5ee8a1d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:15.311016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca15f2a-5cc7-4362-b85f-e556c5ee8a1d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:15.315427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6dec4-42f1-46cb-9593-7d813c3e9462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:15.316266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6dec4-42f1-46cb-9593-7d813c3e9462 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:15.316570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6dec4-42f1-46cb-9593-7d813c3e9462 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:15.316843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6dec4-42f1-46cb-9593-7d813c3e9462 admin admin] PATH_INFO: `/v3/users/0d41935c2834449c838a7a569161c5f2` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:15.330241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6dec4-42f1-46cb-9593-7d813c3e9462 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d41935c2834449c838a7a569161c5f2)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:15.332528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6dec4-42f1-46cb-9593-7d813c3e9462 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:15.334133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 548/1078] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:26:15 2021] GET /identity/v3/users/0d41935c2834449c838a7a569161c5f2 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:15.341133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0705d4-b58e-4136-965b-23c48422f3b6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:15.351109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0705d4-b58e-4136-965b-23c48422f3b6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:15.355771 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583efd7-44be-4455-83e3-9c0b2f319f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:15.356449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583efd7-44be-4455-83e3-9c0b2f319f60 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:15.356734 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583efd7-44be-4455-83e3-9c0b2f319f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:15.357010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583efd7-44be-4455-83e3-9c0b2f319f60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:15.365327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583efd7-44be-4455-83e3-9c0b2f319f60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:15.367702 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583efd7-44be-4455-83e3-9c0b2f319f60 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:15.376989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 531/1079] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:26:15 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:26:15.384403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6dec4-42f1-46cb-9593-7d813c3e9462 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:15.394095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6dec4-42f1-46cb-9593-7d813c3e9462 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:15.398652 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe53cb-e7bd-48b1-b77c-6b855278f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:15.399513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe53cb-e7bd-48b1-b77c-6b855278f124 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:15.399790 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe53cb-e7bd-48b1-b77c-6b855278f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:15.400059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe53cb-e7bd-48b1-b77c-6b855278f124 admin admin] PATH_INFO: `/v3/projects/8da75063c9dd4ebc8f3202442be89fdc` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:15.401311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe53cb-e7bd-48b1-b77c-6b855278f124 admin admin] RBAC: Authorizing `identity:get_project(project_id=8da75063c9dd4ebc8f3202442be89fdc)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:15.403363 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe53cb-e7bd-48b1-b77c-6b855278f124 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:15.405084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 549/1080] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:26:15 2021] GET /identity/v3/projects/8da75063c9dd4ebc8f3202442be89fdc => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:15.411955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583efd7-44be-4455-83e3-9c0b2f319f60 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:15.421203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583efd7-44be-4455-83e3-9c0b2f319f60 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:15.425959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de2d51-b39c-43da-b6dd-7d4e5bee60d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:15.426603 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de2d51-b39c-43da-b6dd-7d4e5bee60d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:15.426886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de2d51-b39c-43da-b6dd-7d4e5bee60d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:15.427166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de2d51-b39c-43da-b6dd-7d4e5bee60d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:15.427992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de2d51-b39c-43da-b6dd-7d4e5bee60d8 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=8da75063c9dd4ebc8f3202442be89fdc, user.id=0d41935c2834449c838a7a569161c5f2) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:26:15.428305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de2d51-b39c-43da-b6dd-7d4e5bee60d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:15.430690 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de2d51-b39c-43da-b6dd-7d4e5bee60d8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:15.436188 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 532/1081] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:26:15 2021] GET /identity/v3/role_assignments?user.id=0d41935c2834449c838a7a569161c5f2&scope.project.id=8da75063c9dd4ebc8f3202442be89fdc&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:17.575422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18df3a-11a3-43c1-95d3-7edf34da9c94 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:17.575988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18df3a-11a3-43c1-95d3-7edf34da9c94 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:17.575988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18df3a-11a3-43c1-95d3-7edf34da9c94 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:17.577755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 550/1082] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:26:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:26:17.583927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6f765-0568-46eb-9839-570be02999bd None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:17.584388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6f765-0568-46eb-9839-570be02999bd None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:17.584587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6f765-0568-46eb-9839-570be02999bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:17.602753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b8c6f765-0568-46eb-9839-570be02999bd None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:26:17.603943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b8c6f765-0568-46eb-9839-570be02999bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:17.611794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 533/1083] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:26:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:26:17.637173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18df3a-11a3-43c1-95d3-7edf34da9c94 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:17.649960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18df3a-11a3-43c1-95d3-7edf34da9c94 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:17.654951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bdb46-ee5a-460c-849f-a7f1169bc301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:17.655737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bdb46-ee5a-460c-849f-a7f1169bc301 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:17.656020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bdb46-ee5a-460c-849f-a7f1169bc301 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:17.656294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bdb46-ee5a-460c-849f-a7f1169bc301 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:17.667756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bdb46-ee5a-460c-849f-a7f1169bc301 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:26:17.674526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-e15bdb46-ee5a-460c-849f-a7f1169bc301 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:26:17.675753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 551/1084] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:26:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:26:17.682908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6f765-0568-46eb-9839-570be02999bd None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:17.692424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6f765-0568-46eb-9839-570be02999bd None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:17.697618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7522af7-e1d3-4ded-b232-06762fa92a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:17.698314 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7522af7-e1d3-4ded-b232-06762fa92a1b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:17.698599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7522af7-e1d3-4ded-b232-06762fa92a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:17.698876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7522af7-e1d3-4ded-b232-06762fa92a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:17.699644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7522af7-e1d3-4ded-b232-06762fa92a1b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:26:17.699955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7522af7-e1d3-4ded-b232-06762fa92a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:17.701853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7522af7-e1d3-4ded-b232-06762fa92a1b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:17.712194 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 534/1085] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:26:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:17.718896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bdb46-ee5a-460c-849f-a7f1169bc301 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:17.732111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bdb46-ee5a-460c-849f-a7f1169bc301 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:17.737653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca6944-b436-46b9-9709-32b1f6d2f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:17.738637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca6944-b436-46b9-9709-32b1f6d2f1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:17.738960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca6944-b436-46b9-9709-32b1f6d2f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:17.739272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca6944-b436-46b9-9709-32b1f6d2f1e3 admin admin] PATH_INFO: `/v3/users/0d41935c2834449c838a7a569161c5f2` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:17.740543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca6944-b436-46b9-9709-32b1f6d2f1e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d41935c2834449c838a7a569161c5f2)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:17.742818 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca6944-b436-46b9-9709-32b1f6d2f1e3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:17.744912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 552/1086] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:26:17 2021] GET /identity/v3/users/0d41935c2834449c838a7a569161c5f2 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:17.751605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7522af7-e1d3-4ded-b232-06762fa92a1b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:17.762163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7522af7-e1d3-4ded-b232-06762fa92a1b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:17.767083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dc1dd-831e-45cd-9ac8-ebf0a4e41b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:17.767950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc1dd-831e-45cd-9ac8-ebf0a4e41b35 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:17.768232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc1dd-831e-45cd-9ac8-ebf0a4e41b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:17.768557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc1dd-831e-45cd-9ac8-ebf0a4e41b35 admin admin] PATH_INFO: `/v3/projects/8da75063c9dd4ebc8f3202442be89fdc` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:17.769836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799dc1dd-831e-45cd-9ac8-ebf0a4e41b35 admin admin] RBAC: Authorizing `identity:get_project(project_id=8da75063c9dd4ebc8f3202442be89fdc)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:17.772137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799dc1dd-831e-45cd-9ac8-ebf0a4e41b35 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:17.774452 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 535/1087] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:26:17 2021] GET /identity/v3/projects/8da75063c9dd4ebc8f3202442be89fdc => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:17.781418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca6944-b436-46b9-9709-32b1f6d2f1e3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:17.792289 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca6944-b436-46b9-9709-32b1f6d2f1e3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:17.796990 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e49c9-cfbe-41c5-bd01-20721b98121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:17.797882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e49c9-cfbe-41c5-bd01-20721b98121d admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:17.798163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e49c9-cfbe-41c5-bd01-20721b98121d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:17.798439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e49c9-cfbe-41c5-bd01-20721b98121d admin admin] PATH_INFO: `/v3/projects/8da75063c9dd4ebc8f3202442be89fdc/users/0d41935c2834449c838a7a569161c5f2/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:17.800444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e49c9-cfbe-41c5-bd01-20721b98121d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da75063c9dd4ebc8f3202442be89fdc, user_id=0d41935c2834449c838a7a569161c5f2, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:17.803193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e49c9-cfbe-41c5-bd01-20721b98121d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:17.886179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 553/1088] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:26:17 2021] PUT /identity/v3/projects/8da75063c9dd4ebc8f3202442be89fdc/users/0d41935c2834449c838a7a569161c5f2/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:26:20.023544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afcf07-b69c-4864-b8cb-e41ca910133e None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:20.024056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afcf07-b69c-4864-b8cb-e41ca910133e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:20.024056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afcf07-b69c-4864-b8cb-e41ca910133e None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:20.025825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 536/1089] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:26:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:26:20.032171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2181c-d043-4ba9-bf99-dfaa9f9bdadb None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:20.032603 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2181c-d043-4ba9-bf99-dfaa9f9bdadb None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:20.032769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2181c-d043-4ba9-bf99-dfaa9f9bdadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:20.050718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a2e2181c-d043-4ba9-bf99-dfaa9f9bdadb None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:26:20.051932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a2e2181c-d043-4ba9-bf99-dfaa9f9bdadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:20.109717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 554/1090] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:26:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:26:20.135616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afcf07-b69c-4864-b8cb-e41ca910133e None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:20.147611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afcf07-b69c-4864-b8cb-e41ca910133e None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:20.152011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39e776-c6cd-41d7-806d-0c905d20ae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:20.152804 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e776-c6cd-41d7-806d-0c905d20ae51 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:20.153088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e776-c6cd-41d7-806d-0c905d20ae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:20.153359 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e776-c6cd-41d7-806d-0c905d20ae51 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:20.163392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39e776-c6cd-41d7-806d-0c905d20ae51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:26:20.170323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-fe39e776-c6cd-41d7-806d-0c905d20ae51 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:26:20.171445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 537/1091] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:26:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:26:20.177978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2181c-d043-4ba9-bf99-dfaa9f9bdadb None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:20.187078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2181c-d043-4ba9-bf99-dfaa9f9bdadb None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:20.191497 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1d671-3379-4c42-b9bf-dec4ac7f6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:20.192135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1d671-3379-4c42-b9bf-dec4ac7f6ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:20.192506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1d671-3379-4c42-b9bf-dec4ac7f6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:20.192783 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1d671-3379-4c42-b9bf-dec4ac7f6ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:20.193520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1d671-3379-4c42-b9bf-dec4ac7f6ec9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:26:20.193819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1d671-3379-4c42-b9bf-dec4ac7f6ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:20.196009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1d671-3379-4c42-b9bf-dec4ac7f6ec9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:20.203889 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 555/1092] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:26:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:20.210020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39e776-c6cd-41d7-806d-0c905d20ae51 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:20.219873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39e776-c6cd-41d7-806d-0c905d20ae51 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:20.224471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574f532-d462-4401-9066-462d2ee02967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:20.225339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574f532-d462-4401-9066-462d2ee02967 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:20.225682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574f532-d462-4401-9066-462d2ee02967 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:20.225874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574f532-d462-4401-9066-462d2ee02967 admin admin] PATH_INFO: `/v3/users/0d41935c2834449c838a7a569161c5f2` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:20.227107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574f532-d462-4401-9066-462d2ee02967 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d41935c2834449c838a7a569161c5f2)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:20.229385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574f532-d462-4401-9066-462d2ee02967 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:20.230898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 538/1093] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:26:20 2021] GET /identity/v3/users/0d41935c2834449c838a7a569161c5f2 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:20.237334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1d671-3379-4c42-b9bf-dec4ac7f6ec9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:20.247377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1d671-3379-4c42-b9bf-dec4ac7f6ec9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:20.251893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339923d2-020f-426a-b7ac-57e06a91b326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:20.252552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339923d2-020f-426a-b7ac-57e06a91b326 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:20.252835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339923d2-020f-426a-b7ac-57e06a91b326 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:20.253107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339923d2-020f-426a-b7ac-57e06a91b326 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:20.261720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339923d2-020f-426a-b7ac-57e06a91b326 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:20.263461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339923d2-020f-426a-b7ac-57e06a91b326 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:20.272891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 556/1094] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:26:20 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:26:20.279687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574f532-d462-4401-9066-462d2ee02967 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:20.290414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574f532-d462-4401-9066-462d2ee02967 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:20.295253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c643dc-1445-4091-a481-2eb5c34c41d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:20.296095 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c643dc-1445-4091-a481-2eb5c34c41d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:20.296400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c643dc-1445-4091-a481-2eb5c34c41d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:20.296682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c643dc-1445-4091-a481-2eb5c34c41d6 admin admin] PATH_INFO: `/v3/projects/8da75063c9dd4ebc8f3202442be89fdc` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:20.297856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c643dc-1445-4091-a481-2eb5c34c41d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8da75063c9dd4ebc8f3202442be89fdc)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:20.299930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c643dc-1445-4091-a481-2eb5c34c41d6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:20.301651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 539/1095] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:26:20 2021] GET /identity/v3/projects/8da75063c9dd4ebc8f3202442be89fdc => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:26:20.309064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339923d2-020f-426a-b7ac-57e06a91b326 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:20.318123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339923d2-020f-426a-b7ac-57e06a91b326 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:20.322705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361032fe-0000-49ef-a46b-21ef8d17e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:20.323345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361032fe-0000-49ef-a46b-21ef8d17e096 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:20.323626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361032fe-0000-49ef-a46b-21ef8d17e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:20.323902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361032fe-0000-49ef-a46b-21ef8d17e096 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:20.324790 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361032fe-0000-49ef-a46b-21ef8d17e096 admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=8da75063c9dd4ebc8f3202442be89fdc, user.id=0d41935c2834449c838a7a569161c5f2) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:26:20.325098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361032fe-0000-49ef-a46b-21ef8d17e096 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:20.326924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361032fe-0000-49ef-a46b-21ef8d17e096 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:20.333005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 557/1096] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:26:20 2021] GET /identity/v3/role_assignments?user.id=0d41935c2834449c838a7a569161c5f2&scope.project.id=8da75063c9dd4ebc8f3202442be89fdc&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:44.563940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666108d8-7cdc-47de-92d2-80e0643dfb14 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:44.564550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666108d8-7cdc-47de-92d2-80e0643dfb14 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:44.564550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666108d8-7cdc-47de-92d2-80e0643dfb14 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:44.566388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 540/1097] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:27:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:27:44.572250 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a18d2e-2365-4848-8756-d948733044c4 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:44.576547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a18d2e-2365-4848-8756-d948733044c4 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:44.576547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a18d2e-2365-4848-8756-d948733044c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:44.590576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-79a18d2e-2365-4848-8756-d948733044c4 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:27:44.591751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-79a18d2e-2365-4848-8756-d948733044c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:27:44.599339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 558/1098] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:27:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:27:44.624938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666108d8-7cdc-47de-92d2-80e0643dfb14 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:44.637142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666108d8-7cdc-47de-92d2-80e0643dfb14 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:44.641502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2d0cb-94e0-41cf-aeb2-24465f8c91d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:44.642267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2d0cb-94e0-41cf-aeb2-24465f8c91d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:44.642549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2d0cb-94e0-41cf-aeb2-24465f8c91d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:44.642821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2d0cb-94e0-41cf-aeb2-24465f8c91d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:44.653398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2d0cb-94e0-41cf-aeb2-24465f8c91d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:44.655239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2d0cb-94e0-41cf-aeb2-24465f8c91d7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:44.672327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-c2a2d0cb-94e0-41cf-aeb2-24465f8c91d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:44.673490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 541/1099] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:44.680282 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a18d2e-2365-4848-8756-d948733044c4 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:44.689227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a18d2e-2365-4848-8756-d948733044c4 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:44.694513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd65c5b-908e-419e-b414-c59471a450f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:44.695174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd65c5b-908e-419e-b414-c59471a450f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:44.695470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd65c5b-908e-419e-b414-c59471a450f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:44.695741 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd65c5b-908e-419e-b414-c59471a450f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:44.696498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd65c5b-908e-419e-b414-c59471a450f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:44.696802 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd65c5b-908e-419e-b414-c59471a450f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:44.698423 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd65c5b-908e-419e-b414-c59471a450f7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:44.712221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 559/1100] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:44.718887 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2d0cb-94e0-41cf-aeb2-24465f8c91d7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:44.729423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2d0cb-94e0-41cf-aeb2-24465f8c91d7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:44.734255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7d477-c54c-4f40-9e93-758d84a6d4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:44.734921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7d477-c54c-4f40-9e93-758d84a6d4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:44.735200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7d477-c54c-4f40-9e93-758d84a6d4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:44.735474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7d477-c54c-4f40-9e93-758d84a6d4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:44.736194 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7d477-c54c-4f40-9e93-758d84a6d4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:44.738169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7d477-c54c-4f40-9e93-758d84a6d4c5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:44.840158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 542/1101] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 04:27:44 2021] POST /identity/v3/users => generated 251 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:27:47.066935 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2c32-891e-45dd-b7bf-622916748aa7 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.067486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2c32-891e-45dd-b7bf-622916748aa7 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.067486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2c32-891e-45dd-b7bf-622916748aa7 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.069755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 560/1102] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:27:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:27:47.076066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a10f-a31c-4973-a5b3-c9ef5f04b171 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.076553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a10f-a31c-4973-a5b3-c9ef5f04b171 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.076650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a10f-a31c-4973-a5b3-c9ef5f04b171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.095541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b1b1a10f-a31c-4973-a5b3-c9ef5f04b171 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:27:47.096835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b1b1a10f-a31c-4973-a5b3-c9ef5f04b171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:27:47.104467 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 543/1103] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:27:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:27:47.129005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b2c32-891e-45dd-b7bf-622916748aa7 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.141550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b2c32-891e-45dd-b7bf-622916748aa7 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.145935 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0e974-9865-482a-b615-696c22cdeac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.147348 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0e974-9865-482a-b615-696c22cdeac4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.147640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0e974-9865-482a-b615-696c22cdeac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.147912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0e974-9865-482a-b615-696c22cdeac4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.158385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0e974-9865-482a-b615-696c22cdeac4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:27:47.167878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-dcf0e974-9865-482a-b615-696c22cdeac4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:27:47.167878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 561/1104] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:47.173065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1a10f-a31c-4973-a5b3-c9ef5f04b171 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.182097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1a10f-a31c-4973-a5b3-c9ef5f04b171 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.186621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6367d-64f0-4f11-83fe-6efc87c72dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.187284 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6367d-64f0-4f11-83fe-6efc87c72dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.187565 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6367d-64f0-4f11-83fe-6efc87c72dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.187842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6367d-64f0-4f11-83fe-6efc87c72dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.188630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6367d-64f0-4f11-83fe-6efc87c72dd4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:47.188938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6367d-64f0-4f11-83fe-6efc87c72dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.190536 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6367d-64f0-4f11-83fe-6efc87c72dd4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.199390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 544/1105] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:47.205860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0e974-9865-482a-b615-696c22cdeac4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.216519 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0e974-9865-482a-b615-696c22cdeac4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.221316 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea15cf7-405b-4387-9fbf-3963e1b0e7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.222104 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea15cf7-405b-4387-9fbf-3963e1b0e7ed admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.222385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea15cf7-405b-4387-9fbf-3963e1b0e7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.222657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea15cf7-405b-4387-9fbf-3963e1b0e7ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.232998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea15cf7-405b-4387-9fbf-3963e1b0e7ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.234834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea15cf7-405b-4387-9fbf-3963e1b0e7ed admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.251697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-8ea15cf7-405b-4387-9fbf-3963e1b0e7ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:47.252903 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 562/1106] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:47.259870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6367d-64f0-4f11-83fe-6efc87c72dd4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.271031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6367d-64f0-4f11-83fe-6efc87c72dd4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.276238 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936510-0e37-4639-8a1e-5f1c5519dc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.276916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936510-0e37-4639-8a1e-5f1c5519dc73 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.277197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936510-0e37-4639-8a1e-5f1c5519dc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.277473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936510-0e37-4639-8a1e-5f1c5519dc73 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.278196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a936510-0e37-4639-8a1e-5f1c5519dc73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:47.278500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a936510-0e37-4639-8a1e-5f1c5519dc73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.280098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a936510-0e37-4639-8a1e-5f1c5519dc73 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.291912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 545/1107] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:47.298437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea15cf7-405b-4387-9fbf-3963e1b0e7ed admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.313397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea15cf7-405b-4387-9fbf-3963e1b0e7ed admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.319025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564de78f-9aef-4da1-9498-16eaa2d7fcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.319825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564de78f-9aef-4da1-9498-16eaa2d7fcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.320107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564de78f-9aef-4da1-9498-16eaa2d7fcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.320413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564de78f-9aef-4da1-9498-16eaa2d7fcf7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.329148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564de78f-9aef-4da1-9498-16eaa2d7fcf7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.331279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564de78f-9aef-4da1-9498-16eaa2d7fcf7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.345984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-564de78f-9aef-4da1-9498-16eaa2d7fcf7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:27:47.347274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 563/1108] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:47.353897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936510-0e37-4639-8a1e-5f1c5519dc73 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.363837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936510-0e37-4639-8a1e-5f1c5519dc73 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.369317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d05ad-f85e-408c-92df-b7d4aae3d49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.370008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d05ad-f85e-408c-92df-b7d4aae3d49b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.370291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d05ad-f85e-408c-92df-b7d4aae3d49b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.370568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d05ad-f85e-408c-92df-b7d4aae3d49b admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.371427 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d05ad-f85e-408c-92df-b7d4aae3d49b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:47.371732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d05ad-f85e-408c-92df-b7d4aae3d49b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.373666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d05ad-f85e-408c-92df-b7d4aae3d49b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.392706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 546/1109] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:27:47.399473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564de78f-9aef-4da1-9498-16eaa2d7fcf7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.409432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564de78f-9aef-4da1-9498-16eaa2d7fcf7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.414760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2c9f5-a666-46b7-b14c-a160f60255fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.415420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c9f5-a666-46b7-b14c-a160f60255fa admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.415960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c9f5-a666-46b7-b14c-a160f60255fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.416241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c9f5-a666-46b7-b14c-a160f60255fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.424598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2c9f5-a666-46b7-b14c-a160f60255fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.426364 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2c9f5-a666-46b7-b14c-a160f60255fa admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.435716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 564/1110] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:27:47.442239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d05ad-f85e-408c-92df-b7d4aae3d49b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.452644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d05ad-f85e-408c-92df-b7d4aae3d49b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.457415 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc1784-3679-470e-a4b2-386916b7f0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.458182 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc1784-3679-470e-a4b2-386916b7f0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.458460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc1784-3679-470e-a4b2-386916b7f0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.458732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc1784-3679-470e-a4b2-386916b7f0d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.469101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc1784-3679-470e-a4b2-386916b7f0d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.470942 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc1784-3679-470e-a4b2-386916b7f0d7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.487668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-5ebc1784-3679-470e-a4b2-386916b7f0d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:47.488971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 547/1111] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:47.495941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2c9f5-a666-46b7-b14c-a160f60255fa admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.504887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2c9f5-a666-46b7-b14c-a160f60255fa admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.510329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc583d-0036-4390-989c-08536a9dc161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.510972 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc583d-0036-4390-989c-08536a9dc161 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.511256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc583d-0036-4390-989c-08536a9dc161 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.511560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc583d-0036-4390-989c-08536a9dc161 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.512247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc583d-0036-4390-989c-08536a9dc161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:47.512578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc583d-0036-4390-989c-08536a9dc161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.514157 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc583d-0036-4390-989c-08536a9dc161 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.525523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 565/1112] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:47.532081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc1784-3679-470e-a4b2-386916b7f0d7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.542132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc1784-3679-470e-a4b2-386916b7f0d7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.546713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbe89e-de1d-45b7-857e-dbc07349a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.547518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbe89e-de1d-45b7-857e-dbc07349a495 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.547802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbe89e-de1d-45b7-857e-dbc07349a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.548075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbe89e-de1d-45b7-857e-dbc07349a495 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.555724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbe89e-de1d-45b7-857e-dbc07349a495 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.557817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbe89e-de1d-45b7-857e-dbc07349a495 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.571354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-f6bbe89e-de1d-45b7-857e-dbc07349a495 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:27:47.572510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 548/1113] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:47.579128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc583d-0036-4390-989c-08536a9dc161 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.588876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc583d-0036-4390-989c-08536a9dc161 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.593516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a38ff-4f8e-425a-abb1-27e264c8cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.594158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a38ff-4f8e-425a-abb1-27e264c8cfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.594438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a38ff-4f8e-425a-abb1-27e264c8cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.594708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a38ff-4f8e-425a-abb1-27e264c8cfb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.595478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a38ff-4f8e-425a-abb1-27e264c8cfb9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:47.595779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a38ff-4f8e-425a-abb1-27e264c8cfb9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.597658 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a38ff-4f8e-425a-abb1-27e264c8cfb9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.609701 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 566/1114] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:47.617206 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbe89e-de1d-45b7-857e-dbc07349a495 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:47.627596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbe89e-de1d-45b7-857e-dbc07349a495 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:47.632841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67618b-9c73-4154-8e24-1ebc19fca113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:47.635915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67618b-9c73-4154-8e24-1ebc19fca113 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:47.635915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67618b-9c73-4154-8e24-1ebc19fca113 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:47.635915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67618b-9c73-4154-8e24-1ebc19fca113 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:47.635915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67618b-9c73-4154-8e24-1ebc19fca113 admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=3ef904ebfd2c4372b169ba7804278f19) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:47.635915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67618b-9c73-4154-8e24-1ebc19fca113 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:47.636988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67618b-9c73-4154-8e24-1ebc19fca113 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:47.642379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 549/1115] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:27:47 2021] GET /identity/v3/role_assignments?user.id=3ef904ebfd2c4372b169ba7804278f19&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:27:49.809509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccd413-0015-4808-9cb5-999aaf6952eb None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:49.810091 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccd413-0015-4808-9cb5-999aaf6952eb None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:49.810091 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccd413-0015-4808-9cb5-999aaf6952eb None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:49.811819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 567/1116] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:27:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:27:49.817601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3b9d5-7268-40d1-aba3-ce222a850f9c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:49.818029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3b9d5-7268-40d1-aba3-ce222a850f9c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:49.818163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3b9d5-7268-40d1-aba3-ce222a850f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:49.836385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-f9c3b9d5-7268-40d1-aba3-ce222a850f9c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:27:49.837586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f9c3b9d5-7268-40d1-aba3-ce222a850f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:27:49.845358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 550/1117] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:27:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:27:49.870715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccd413-0015-4808-9cb5-999aaf6952eb None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:49.883438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccd413-0015-4808-9cb5-999aaf6952eb None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:49.887827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4fa02-27bc-46b8-a437-966124a88243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:49.888658 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4fa02-27bc-46b8-a437-966124a88243 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:49.888935 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4fa02-27bc-46b8-a437-966124a88243 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:49.889206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4fa02-27bc-46b8-a437-966124a88243 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:49.900811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4fa02-27bc-46b8-a437-966124a88243 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:27:49.907715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-bba4fa02-27bc-46b8-a437-966124a88243 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:27:49.909032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 568/1118] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:27:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:49.916834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3b9d5-7268-40d1-aba3-ce222a850f9c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:49.926621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3b9d5-7268-40d1-aba3-ce222a850f9c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:49.931946 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db2871-675f-4478-bd2a-0a52291c02ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:49.946739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db2871-675f-4478-bd2a-0a52291c02ec admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:49.946739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db2871-675f-4478-bd2a-0a52291c02ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:49.946739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db2871-675f-4478-bd2a-0a52291c02ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:49.946739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db2871-675f-4478-bd2a-0a52291c02ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:49.946739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db2871-675f-4478-bd2a-0a52291c02ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:49.946739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db2871-675f-4478-bd2a-0a52291c02ec admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:49.947280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 551/1119] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:27:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:49.952615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4fa02-27bc-46b8-a437-966124a88243 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:49.965979 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4fa02-27bc-46b8-a437-966124a88243 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:49.970643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0156ddd-547f-4a57-8a85-17fe715c0f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:49.971427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0156ddd-547f-4a57-8a85-17fe715c0f2c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:49.971713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0156ddd-547f-4a57-8a85-17fe715c0f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:49.971992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0156ddd-547f-4a57-8a85-17fe715c0f2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:49.987258 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0156ddd-547f-4a57-8a85-17fe715c0f2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:49.994086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0156ddd-547f-4a57-8a85-17fe715c0f2c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:50.013118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-d0156ddd-547f-4a57-8a85-17fe715c0f2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:50.014334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 569/1120] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:50.022521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db2871-675f-4478-bd2a-0a52291c02ec admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:50.033656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db2871-675f-4478-bd2a-0a52291c02ec admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:50.039406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd7c08-c77d-4663-b6b9-dc8bb3f61b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:50.040058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7c08-c77d-4663-b6b9-dc8bb3f61b53 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:50.040339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7c08-c77d-4663-b6b9-dc8bb3f61b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:50.040885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7c08-c77d-4663-b6b9-dc8bb3f61b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:50.041612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd7c08-c77d-4663-b6b9-dc8bb3f61b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:50.041914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd7c08-c77d-4663-b6b9-dc8bb3f61b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:50.043817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd7c08-c77d-4663-b6b9-dc8bb3f61b53 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:50.056578 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 552/1121] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:27:50.063481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0156ddd-547f-4a57-8a85-17fe715c0f2c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:50.073616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0156ddd-547f-4a57-8a85-17fe715c0f2c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:50.078245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520d98e-e142-4758-809d-fe8b67f1cd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:50.079159 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d98e-e142-4758-809d-fe8b67f1cd57 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:50.079445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d98e-e142-4758-809d-fe8b67f1cd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:50.079714 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d98e-e142-4758-809d-fe8b67f1cd57 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:50.087799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520d98e-e142-4758-809d-fe8b67f1cd57 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:50.089845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520d98e-e142-4758-809d-fe8b67f1cd57 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:50.104786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-d520d98e-e142-4758-809d-fe8b67f1cd57 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:27:50.105983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 570/1122] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:50 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:50.112800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd7c08-c77d-4663-b6b9-dc8bb3f61b53 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:50.123830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd7c08-c77d-4663-b6b9-dc8bb3f61b53 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:50.128648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c46ac-0078-4327-8a28-e4010ac2805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:50.129295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c46ac-0078-4327-8a28-e4010ac2805b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:50.129572 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c46ac-0078-4327-8a28-e4010ac2805b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:50.129846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c46ac-0078-4327-8a28-e4010ac2805b admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:50.130747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c46ac-0078-4327-8a28-e4010ac2805b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:50.131116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c46ac-0078-4327-8a28-e4010ac2805b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:50.133086 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c46ac-0078-4327-8a28-e4010ac2805b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:50.151102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 553/1123] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 04:27:50 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:50.157337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520d98e-e142-4758-809d-fe8b67f1cd57 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:50.167647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520d98e-e142-4758-809d-fe8b67f1cd57 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:50.172133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888eaae-251a-46ab-9546-7f3a3b1510bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:50.172962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888eaae-251a-46ab-9546-7f3a3b1510bf admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:50.173242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888eaae-251a-46ab-9546-7f3a3b1510bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:50.173513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888eaae-251a-46ab-9546-7f3a3b1510bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:50.183949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888eaae-251a-46ab-9546-7f3a3b1510bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:50.185816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888eaae-251a-46ab-9546-7f3a3b1510bf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:50.202414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-b888eaae-251a-46ab-9546-7f3a3b1510bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:50.203582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 571/1124] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:50.210314 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c46ac-0078-4327-8a28-e4010ac2805b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:50.227714 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c46ac-0078-4327-8a28-e4010ac2805b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:50.235453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cea64-764c-40ee-9504-b443736a4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:50.236667 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cea64-764c-40ee-9504-b443736a4f98 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:50.237160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cea64-764c-40ee-9504-b443736a4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:50.237700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cea64-764c-40ee-9504-b443736a4f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:50.239079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cea64-764c-40ee-9504-b443736a4f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:50.239623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cea64-764c-40ee-9504-b443736a4f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:50.243244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cea64-764c-40ee-9504-b443736a4f98 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:50.263781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 554/1125] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:50.270178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888eaae-251a-46ab-9546-7f3a3b1510bf admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:50.280714 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888eaae-251a-46ab-9546-7f3a3b1510bf admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:50.285336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532c190-97b4-450f-bf99-8bf3e6ab6e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:50.286111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532c190-97b4-450f-bf99-8bf3e6ab6e73 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:50.286396 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532c190-97b4-450f-bf99-8bf3e6ab6e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:50.286692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532c190-97b4-450f-bf99-8bf3e6ab6e73 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:50.309403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532c190-97b4-450f-bf99-8bf3e6ab6e73 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:50.311369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532c190-97b4-450f-bf99-8bf3e6ab6e73 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:50.329946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-3532c190-97b4-450f-bf99-8bf3e6ab6e73 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:27:50.331202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 572/1126] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:27:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:50.339880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cea64-764c-40ee-9504-b443736a4f98 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:50.349750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cea64-764c-40ee-9504-b443736a4f98 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:50.355138 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7a637-db91-4bd5-9080-e4b7bd713ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:50.355787 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7a637-db91-4bd5-9080-e4b7bd713ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:50.356068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7a637-db91-4bd5-9080-e4b7bd713ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:50.356341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7a637-db91-4bd5-9080-e4b7bd713ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:50.357156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7a637-db91-4bd5-9080-e4b7bd713ed1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:50.357461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7a637-db91-4bd5-9080-e4b7bd713ed1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:50.359330 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7a637-db91-4bd5-9080-e4b7bd713ed1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:50.372405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 555/1127] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:27:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:50.378965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532c190-97b4-450f-bf99-8bf3e6ab6e73 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:50.389688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532c190-97b4-450f-bf99-8bf3e6ab6e73 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:50.394302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026623-5746-45b9-9b7a-0a627149add1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:50.395164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026623-5746-45b9-9b7a-0a627149add1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:50.395433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026623-5746-45b9-9b7a-0a627149add1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:50.395702 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026623-5746-45b9-9b7a-0a627149add1 admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/3ef904ebfd2c4372b169ba7804278f19/roles/0bf399b6291e451e9c1560112432ef33` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:50.411658 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026623-5746-45b9-9b7a-0a627149add1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=3ef904ebfd2c4372b169ba7804278f19, role_id=0bf399b6291e451e9c1560112432ef33)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:50.414941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026623-5746-45b9-9b7a-0a627149add1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:50.549127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 573/1128] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:27:50 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/3ef904ebfd2c4372b169ba7804278f19/roles/0bf399b6291e451e9c1560112432ef33 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:27:52.740797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87555e7-581d-4e5b-bc84-bfecc2c7ca0d None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:52.741324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87555e7-581d-4e5b-bc84-bfecc2c7ca0d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:52.741324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87555e7-581d-4e5b-bc84-bfecc2c7ca0d None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:52.743146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 556/1129] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:27:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:27:52.749156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ef39a-cc8b-4029-a61b-4e6956f3a9e8 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:52.749647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ef39a-cc8b-4029-a61b-4e6956f3a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:52.749773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ef39a-cc8b-4029-a61b-4e6956f3a9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:52.767671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-7f3ef39a-cc8b-4029-a61b-4e6956f3a9e8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:27:52.768923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7f3ef39a-cc8b-4029-a61b-4e6956f3a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:27:52.825850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 574/1130] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:27:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:27:52.851924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87555e7-581d-4e5b-bc84-bfecc2c7ca0d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:52.864333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87555e7-581d-4e5b-bc84-bfecc2c7ca0d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:52.868906 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299fa43-2147-4dcd-98b8-01ec67434e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:52.869682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299fa43-2147-4dcd-98b8-01ec67434e15 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:52.869963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299fa43-2147-4dcd-98b8-01ec67434e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:52.870242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299fa43-2147-4dcd-98b8-01ec67434e15 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:52.881039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299fa43-2147-4dcd-98b8-01ec67434e15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:27:52.887874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-1299fa43-2147-4dcd-98b8-01ec67434e15 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:27:52.889078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 557/1131] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 04:27:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:52.895849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ef39a-cc8b-4029-a61b-4e6956f3a9e8 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:52.905501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ef39a-cc8b-4029-a61b-4e6956f3a9e8 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:52.910255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b0e77-80ef-41ba-8c77-b7e3e28ce31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:52.912592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b0e77-80ef-41ba-8c77-b7e3e28ce31c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:52.912592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b0e77-80ef-41ba-8c77-b7e3e28ce31c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:52.912592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b0e77-80ef-41ba-8c77-b7e3e28ce31c admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:52.912592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b0e77-80ef-41ba-8c77-b7e3e28ce31c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:52.912592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b0e77-80ef-41ba-8c77-b7e3e28ce31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:52.914800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b0e77-80ef-41ba-8c77-b7e3e28ce31c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:52.923204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 575/1132] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 04:27:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:52.929499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299fa43-2147-4dcd-98b8-01ec67434e15 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:52.940585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299fa43-2147-4dcd-98b8-01ec67434e15 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:52.945545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c372c6a-b103-4b7e-a4d2-7a6404dd584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:52.946346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372c6a-b103-4b7e-a4d2-7a6404dd584a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:52.946578 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372c6a-b103-4b7e-a4d2-7a6404dd584a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:52.946848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372c6a-b103-4b7e-a4d2-7a6404dd584a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:52.956823 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c372c6a-b103-4b7e-a4d2-7a6404dd584a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:52.958677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c372c6a-b103-4b7e-a4d2-7a6404dd584a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:52.976472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-0c372c6a-b103-4b7e-a4d2-7a6404dd584a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:52.977662 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 558/1133] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:52.984182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b0e77-80ef-41ba-8c77-b7e3e28ce31c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:52.993799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b0e77-80ef-41ba-8c77-b7e3e28ce31c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:52.998494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed6fe2-09e4-49a8-a9b6-879057e60694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:52.999130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed6fe2-09e4-49a8-a9b6-879057e60694 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:52.999409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed6fe2-09e4-49a8-a9b6-879057e60694 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:52.999678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed6fe2-09e4-49a8-a9b6-879057e60694 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:53.000416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed6fe2-09e4-49a8-a9b6-879057e60694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:53.000719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed6fe2-09e4-49a8-a9b6-879057e60694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:53.002279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed6fe2-09e4-49a8-a9b6-879057e60694 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:53.014456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 576/1134] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:53.020595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c372c6a-b103-4b7e-a4d2-7a6404dd584a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:53.031252 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c372c6a-b103-4b7e-a4d2-7a6404dd584a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:53.036115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8700045-ce1f-48ab-bfe1-bdf2a48bc924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:53.036940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8700045-ce1f-48ab-bfe1-bdf2a48bc924 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:53.037221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8700045-ce1f-48ab-bfe1-bdf2a48bc924 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:53.037490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8700045-ce1f-48ab-bfe1-bdf2a48bc924 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:53.046194 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8700045-ce1f-48ab-bfe1-bdf2a48bc924 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:53.048226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8700045-ce1f-48ab-bfe1-bdf2a48bc924 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:53.062621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-f8700045-ce1f-48ab-bfe1-bdf2a48bc924 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:27:53.063989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 559/1135] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:53 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:27:53.071094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed6fe2-09e4-49a8-a9b6-879057e60694 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:53.080971 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed6fe2-09e4-49a8-a9b6-879057e60694 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:53.086665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749375d-43b4-43bb-b0df-32db05c0e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:53.087317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749375d-43b4-43bb-b0df-32db05c0e522 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:53.087643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749375d-43b4-43bb-b0df-32db05c0e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:53.087920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749375d-43b4-43bb-b0df-32db05c0e522 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:53.088794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749375d-43b4-43bb-b0df-32db05c0e522 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:53.089105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749375d-43b4-43bb-b0df-32db05c0e522 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:53.090931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749375d-43b4-43bb-b0df-32db05c0e522 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:53.108501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 577/1136] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 04:27:53 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:53.115107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8700045-ce1f-48ab-bfe1-bdf2a48bc924 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:53.124961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8700045-ce1f-48ab-bfe1-bdf2a48bc924 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:53.129926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b5da7-c76e-4029-9dfd-82c812d21cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:53.130553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b5da7-c76e-4029-9dfd-82c812d21cca admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:53.130832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b5da7-c76e-4029-9dfd-82c812d21cca admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:53.131099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b5da7-c76e-4029-9dfd-82c812d21cca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:53.139437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b5da7-c76e-4029-9dfd-82c812d21cca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:53.141215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b5da7-c76e-4029-9dfd-82c812d21cca admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:53.150520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 560/1137] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:27:53 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:27:53.156867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749375d-43b4-43bb-b0df-32db05c0e522 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:53.166906 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749375d-43b4-43bb-b0df-32db05c0e522 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:53.171387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdfb8d-50d0-4bd4-a30d-6805669fef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:53.172150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdfb8d-50d0-4bd4-a30d-6805669fef04 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:53.172463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdfb8d-50d0-4bd4-a30d-6805669fef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:53.172732 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdfb8d-50d0-4bd4-a30d-6805669fef04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:53.182678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdfb8d-50d0-4bd4-a30d-6805669fef04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:53.184538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdfb8d-50d0-4bd4-a30d-6805669fef04 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:53.201431 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-12cdfb8d-50d0-4bd4-a30d-6805669fef04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:53.202515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 578/1138] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:53.208795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b5da7-c76e-4029-9dfd-82c812d21cca admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:53.218173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b5da7-c76e-4029-9dfd-82c812d21cca admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:53.222893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9eb21-db75-407f-9a31-ece7c8405d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:53.223535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eb21-db75-407f-9a31-ece7c8405d99 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:53.223819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eb21-db75-407f-9a31-ece7c8405d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:53.224097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eb21-db75-407f-9a31-ece7c8405d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:53.224858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9eb21-db75-407f-9a31-ece7c8405d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:53.225168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9eb21-db75-407f-9a31-ece7c8405d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:53.226825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9eb21-db75-407f-9a31-ece7c8405d99 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:53.238111 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 561/1139] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:53.244337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdfb8d-50d0-4bd4-a30d-6805669fef04 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:53.253846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdfb8d-50d0-4bd4-a30d-6805669fef04 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:53.258927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16640-fdea-4c17-bf90-7c331e408583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:53.259691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16640-fdea-4c17-bf90-7c331e408583 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:53.259966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16640-fdea-4c17-bf90-7c331e408583 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:53.260237 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16640-fdea-4c17-bf90-7c331e408583 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:53.266916 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f16640-fdea-4c17-bf90-7c331e408583 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:53.268892 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f16640-fdea-4c17-bf90-7c331e408583 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:53.281942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-41f16640-fdea-4c17-bf90-7c331e408583 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:27:53.283056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 579/1140] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:27:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:53.289377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9eb21-db75-407f-9a31-ece7c8405d99 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:53.299349 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9eb21-db75-407f-9a31-ece7c8405d99 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:53.304513 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf3f0f-a1e7-4850-a68b-e8da56e50c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:53.305148 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf3f0f-a1e7-4850-a68b-e8da56e50c87 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:53.305426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf3f0f-a1e7-4850-a68b-e8da56e50c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:53.305697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf3f0f-a1e7-4850-a68b-e8da56e50c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:53.306472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf3f0f-a1e7-4850-a68b-e8da56e50c87 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:53.306780 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf3f0f-a1e7-4850-a68b-e8da56e50c87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:53.308647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf3f0f-a1e7-4850-a68b-e8da56e50c87 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:53.321015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 562/1141] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:27:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:53.327847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16640-fdea-4c17-bf90-7c331e408583 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:53.338497 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16640-fdea-4c17-bf90-7c331e408583 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:53.343038 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714a38-b3e8-4f6b-bb11-3ad59b35cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:53.343662 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714a38-b3e8-4f6b-bb11-3ad59b35cc89 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:53.352630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714a38-b3e8-4f6b-bb11-3ad59b35cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:53.352630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714a38-b3e8-4f6b-bb11-3ad59b35cc89 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:53.352630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714a38-b3e8-4f6b-bb11-3ad59b35cc89 admin admin] RBAC: Adding query filter params (role.id=0bf399b6291e451e9c1560112432ef33, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=3ef904ebfd2c4372b169ba7804278f19) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:53.352630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714a38-b3e8-4f6b-bb11-3ad59b35cc89 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:53.352630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714a38-b3e8-4f6b-bb11-3ad59b35cc89 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:53.353073 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 580/1142] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:27:53 2021] GET /identity/v3/role_assignments?user.id=3ef904ebfd2c4372b169ba7804278f19&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=0bf399b6291e451e9c1560112432ef33 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:27:55.552299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e43e6-470b-4657-9a11-05d5f9d1cc55 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:55.552858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e43e6-470b-4657-9a11-05d5f9d1cc55 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:55.552974 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e43e6-470b-4657-9a11-05d5f9d1cc55 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:55.554678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 563/1143] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:27:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:27:55.560640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75754fa2-63f2-497e-9e49-2ff9076bceb6 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:55.561057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75754fa2-63f2-497e-9e49-2ff9076bceb6 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:55.561264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75754fa2-63f2-497e-9e49-2ff9076bceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:55.578436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-75754fa2-63f2-497e-9e49-2ff9076bceb6 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:27:55.579640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-75754fa2-63f2-497e-9e49-2ff9076bceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:27:55.587857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 581/1144] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:27:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:27:55.613160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e43e6-470b-4657-9a11-05d5f9d1cc55 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:55.627029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e43e6-470b-4657-9a11-05d5f9d1cc55 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:55.632936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b0855-cfaa-4def-8d30-c7fc7b10e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:55.633899 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0855-cfaa-4def-8d30-c7fc7b10e473 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:55.634290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0855-cfaa-4def-8d30-c7fc7b10e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:55.634655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0855-cfaa-4def-8d30-c7fc7b10e473 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:55.645083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b0855-cfaa-4def-8d30-c7fc7b10e473 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:27:55.652338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-7b3b0855-cfaa-4def-8d30-c7fc7b10e473 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:27:55.653560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 564/1145] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:27:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:55.660326 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75754fa2-63f2-497e-9e49-2ff9076bceb6 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:55.670706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75754fa2-63f2-497e-9e49-2ff9076bceb6 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:55.675393 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52f3eb-4c1d-4a6b-9c97-70f977bdab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:55.676062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f3eb-4c1d-4a6b-9c97-70f977bdab3f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:55.676366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f3eb-4c1d-4a6b-9c97-70f977bdab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:55.676656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f3eb-4c1d-4a6b-9c97-70f977bdab3f admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:55.677413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52f3eb-4c1d-4a6b-9c97-70f977bdab3f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:55.677722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52f3eb-4c1d-4a6b-9c97-70f977bdab3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:55.679371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52f3eb-4c1d-4a6b-9c97-70f977bdab3f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:55.688151 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 582/1146] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:27:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:55.694677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b0855-cfaa-4def-8d30-c7fc7b10e473 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:55.705181 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b0855-cfaa-4def-8d30-c7fc7b10e473 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:55.710213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130e944-5f04-44ca-8ff7-ce989ceaf6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:55.711112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130e944-5f04-44ca-8ff7-ce989ceaf6aa admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:55.711256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130e944-5f04-44ca-8ff7-ce989ceaf6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:55.711494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130e944-5f04-44ca-8ff7-ce989ceaf6aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:55.721829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130e944-5f04-44ca-8ff7-ce989ceaf6aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:55.723956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130e944-5f04-44ca-8ff7-ce989ceaf6aa admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:55.742615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-d130e944-5f04-44ca-8ff7-ce989ceaf6aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:55.743844 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 565/1147] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:55.750579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52f3eb-4c1d-4a6b-9c97-70f977bdab3f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:55.762772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52f3eb-4c1d-4a6b-9c97-70f977bdab3f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:55.767560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d0e2f-e5c2-4fba-acc5-d881ccfc996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:55.768217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0e2f-e5c2-4fba-acc5-d881ccfc996b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:55.768540 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0e2f-e5c2-4fba-acc5-d881ccfc996b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:55.768819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0e2f-e5c2-4fba-acc5-d881ccfc996b admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:55.769586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d0e2f-e5c2-4fba-acc5-d881ccfc996b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:55.769887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d0e2f-e5c2-4fba-acc5-d881ccfc996b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:55.771502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d0e2f-e5c2-4fba-acc5-d881ccfc996b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:55.784368 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 583/1148] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:55.791741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130e944-5f04-44ca-8ff7-ce989ceaf6aa admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:55.801780 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130e944-5f04-44ca-8ff7-ce989ceaf6aa admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:55.806588 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fb1d-2dff-4049-ae8f-3993e7c7e267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:55.807328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fb1d-2dff-4049-ae8f-3993e7c7e267 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:55.807616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fb1d-2dff-4049-ae8f-3993e7c7e267 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:55.807892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fb1d-2dff-4049-ae8f-3993e7c7e267 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:55.816078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225fb1d-2dff-4049-ae8f-3993e7c7e267 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:55.818195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225fb1d-2dff-4049-ae8f-3993e7c7e267 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:55.833203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-1225fb1d-2dff-4049-ae8f-3993e7c7e267 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:27:55.835071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 566/1149] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:55 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:27:55.841921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d0e2f-e5c2-4fba-acc5-d881ccfc996b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:55.852563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d0e2f-e5c2-4fba-acc5-d881ccfc996b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:55.857174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e60e-4f70-4685-b128-e65be386c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:55.857851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e60e-4f70-4685-b128-e65be386c165 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:55.858132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e60e-4f70-4685-b128-e65be386c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:55.858404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e60e-4f70-4685-b128-e65be386c165 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:55.859241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80e60e-4f70-4685-b128-e65be386c165 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:55.859546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80e60e-4f70-4685-b128-e65be386c165 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:55.861449 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80e60e-4f70-4685-b128-e65be386c165 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:55.880569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 584/1150] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 04:27:55 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:55.887078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fb1d-2dff-4049-ae8f-3993e7c7e267 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:55.897501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fb1d-2dff-4049-ae8f-3993e7c7e267 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:55.902796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03784eaf-8896-4cf0-8f1d-def471acf8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:55.903441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03784eaf-8896-4cf0-8f1d-def471acf8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:55.903723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03784eaf-8896-4cf0-8f1d-def471acf8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:55.903998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03784eaf-8896-4cf0-8f1d-def471acf8c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:55.912524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03784eaf-8896-4cf0-8f1d-def471acf8c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:55.914909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03784eaf-8896-4cf0-8f1d-def471acf8c4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:55.924453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 567/1151] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:27:55 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:27:55.931141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e60e-4f70-4685-b128-e65be386c165 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:55.941203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e60e-4f70-4685-b128-e65be386c165 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:55.946383 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6043ac1-549d-44ea-b9d8-c755b304cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:55.947177 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043ac1-549d-44ea-b9d8-c755b304cfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:55.947460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043ac1-549d-44ea-b9d8-c755b304cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:55.947731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043ac1-549d-44ea-b9d8-c755b304cfa4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:55.958771 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6043ac1-549d-44ea-b9d8-c755b304cfa4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:55.961947 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6043ac1-549d-44ea-b9d8-c755b304cfa4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:55.979688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-a6043ac1-549d-44ea-b9d8-c755b304cfa4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:55.980918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 585/1152] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:55.987471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03784eaf-8896-4cf0-8f1d-def471acf8c4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:55.996640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03784eaf-8896-4cf0-8f1d-def471acf8c4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:56.001372 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5377b0-9c5d-4471-a16e-4aea7a849751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:56.002052 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5377b0-9c5d-4471-a16e-4aea7a849751 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:56.002368 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5377b0-9c5d-4471-a16e-4aea7a849751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:56.002703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5377b0-9c5d-4471-a16e-4aea7a849751 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:56.003692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5377b0-9c5d-4471-a16e-4aea7a849751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:56.004080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5377b0-9c5d-4471-a16e-4aea7a849751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:56.005900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5377b0-9c5d-4471-a16e-4aea7a849751 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:56.017763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 568/1153] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:56.024985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6043ac1-549d-44ea-b9d8-c755b304cfa4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:56.034636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6043ac1-549d-44ea-b9d8-c755b304cfa4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:56.039358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12df98f-6f06-43fe-8d40-008c439366d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:56.040128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df98f-6f06-43fe-8d40-008c439366d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:56.040435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df98f-6f06-43fe-8d40-008c439366d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:56.040962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df98f-6f06-43fe-8d40-008c439366d9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:56.047749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12df98f-6f06-43fe-8d40-008c439366d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:56.049711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12df98f-6f06-43fe-8d40-008c439366d9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:56.062146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-a12df98f-6f06-43fe-8d40-008c439366d9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:27:56.063221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 586/1154] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:27:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:56.070216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5377b0-9c5d-4471-a16e-4aea7a849751 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:56.079918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5377b0-9c5d-4471-a16e-4aea7a849751 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:56.085339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8439d97-9694-469c-af49-355cae99f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:56.085979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8439d97-9694-469c-af49-355cae99f4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:56.086265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8439d97-9694-469c-af49-355cae99f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:56.086544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8439d97-9694-469c-af49-355cae99f4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:56.087328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8439d97-9694-469c-af49-355cae99f4e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:56.087634 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8439d97-9694-469c-af49-355cae99f4e9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:56.089619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8439d97-9694-469c-af49-355cae99f4e9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:56.101689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 569/1155] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:27:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:56.108186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12df98f-6f06-43fe-8d40-008c439366d9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:56.118287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12df98f-6f06-43fe-8d40-008c439366d9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:56.122645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88521079-5fd4-40d6-b0c6-fba02684534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:56.123321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88521079-5fd4-40d6-b0c6-fba02684534c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:56.123598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88521079-5fd4-40d6-b0c6-fba02684534c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:56.123867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88521079-5fd4-40d6-b0c6-fba02684534c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:56.124705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88521079-5fd4-40d6-b0c6-fba02684534c admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=3ef904ebfd2c4372b169ba7804278f19) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:56.125009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88521079-5fd4-40d6-b0c6-fba02684534c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:56.126815 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88521079-5fd4-40d6-b0c6-fba02684534c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:56.132583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 587/1156] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:27:56 2021] GET /identity/v3/role_assignments?user.id=3ef904ebfd2c4372b169ba7804278f19&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:58.255799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8da542-7067-40ea-b915-1c9248645abd None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.256889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8da542-7067-40ea-b915-1c9248645abd None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.256889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8da542-7067-40ea-b915-1c9248645abd None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.258684 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 570/1157] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:27:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:27:58.264789 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b25ec5-d79e-4329-9c02-6cb551890141 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.265174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b25ec5-d79e-4329-9c02-6cb551890141 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.265388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b25ec5-d79e-4329-9c02-6cb551890141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.283600 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a9b25ec5-d79e-4329-9c02-6cb551890141 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:27:58.284886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a9b25ec5-d79e-4329-9c02-6cb551890141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:27:58.292909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 588/1158] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:27:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:27:58.316912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8da542-7067-40ea-b915-1c9248645abd None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.329796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8da542-7067-40ea-b915-1c9248645abd None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.334135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69123610-c35a-4c54-972d-72f85b479703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.335587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69123610-c35a-4c54-972d-72f85b479703 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.335915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69123610-c35a-4c54-972d-72f85b479703 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.336158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69123610-c35a-4c54-972d-72f85b479703 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.346687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69123610-c35a-4c54-972d-72f85b479703 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:27:58.353510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-69123610-c35a-4c54-972d-72f85b479703 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:27:58.354657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 571/1159] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:27:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:58.361280 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b25ec5-d79e-4329-9c02-6cb551890141 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.371872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b25ec5-d79e-4329-9c02-6cb551890141 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.379019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d63c3a-cc80-4dec-87f1-48ae13fc0ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.379707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d63c3a-cc80-4dec-87f1-48ae13fc0ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.379996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d63c3a-cc80-4dec-87f1-48ae13fc0ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.380272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d63c3a-cc80-4dec-87f1-48ae13fc0ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.381056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d63c3a-cc80-4dec-87f1-48ae13fc0ec9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:58.381911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d63c3a-cc80-4dec-87f1-48ae13fc0ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:58.383505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d63c3a-cc80-4dec-87f1-48ae13fc0ec9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:58.392180 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 589/1160] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:27:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:58.399199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69123610-c35a-4c54-972d-72f85b479703 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.409188 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69123610-c35a-4c54-972d-72f85b479703 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.414006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fea3e-b33e-471b-af73-21565f38925b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.414783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fea3e-b33e-471b-af73-21565f38925b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.415067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fea3e-b33e-471b-af73-21565f38925b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.415401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fea3e-b33e-471b-af73-21565f38925b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.426341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fea3e-b33e-471b-af73-21565f38925b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:58.430513 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fea3e-b33e-471b-af73-21565f38925b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:58.445180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-b19fea3e-b33e-471b-af73-21565f38925b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:58.446324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 572/1161] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:58.452739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d63c3a-cc80-4dec-87f1-48ae13fc0ec9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.462910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d63c3a-cc80-4dec-87f1-48ae13fc0ec9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.467518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ad673-bcd7-4744-a848-c5c0ebb0e868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.468166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ad673-bcd7-4744-a848-c5c0ebb0e868 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.468481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ad673-bcd7-4744-a848-c5c0ebb0e868 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.468758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ad673-bcd7-4744-a848-c5c0ebb0e868 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.469464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ad673-bcd7-4744-a848-c5c0ebb0e868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:58.469766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ad673-bcd7-4744-a848-c5c0ebb0e868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:58.471336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ad673-bcd7-4744-a848-c5c0ebb0e868 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:58.482636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 590/1162] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:58.488972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fea3e-b33e-471b-af73-21565f38925b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.498585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fea3e-b33e-471b-af73-21565f38925b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.503135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c1e6a-7791-40a5-a48c-387ba4c1954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.503903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c1e6a-7791-40a5-a48c-387ba4c1954e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.504184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c1e6a-7791-40a5-a48c-387ba4c1954e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.504491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c1e6a-7791-40a5-a48c-387ba4c1954e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.512216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c1e6a-7791-40a5-a48c-387ba4c1954e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:58.514235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c1e6a-7791-40a5-a48c-387ba4c1954e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:58.528560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-164c1e6a-7791-40a5-a48c-387ba4c1954e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:27:58.529683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 573/1163] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:58 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:58.536023 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ad673-bcd7-4744-a848-c5c0ebb0e868 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.545951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ad673-bcd7-4744-a848-c5c0ebb0e868 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.550689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5351-8d8e-4619-8e80-e08640ea7dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.551474 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5351-8d8e-4619-8e80-e08640ea7dde admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.551760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5351-8d8e-4619-8e80-e08640ea7dde admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.552040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5351-8d8e-4619-8e80-e08640ea7dde admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.552992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d5351-8d8e-4619-8e80-e08640ea7dde admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:58.553794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d5351-8d8e-4619-8e80-e08640ea7dde admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:58.555969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d5351-8d8e-4619-8e80-e08640ea7dde admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:58.573284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 591/1164] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 04:27:58 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:58.579552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c1e6a-7791-40a5-a48c-387ba4c1954e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.588957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c1e6a-7791-40a5-a48c-387ba4c1954e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.593464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54dcd3-7df7-4f14-8f42-359b6c41004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.594225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54dcd3-7df7-4f14-8f42-359b6c41004a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.594542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54dcd3-7df7-4f14-8f42-359b6c41004a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.594774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54dcd3-7df7-4f14-8f42-359b6c41004a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.604675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54dcd3-7df7-4f14-8f42-359b6c41004a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:58.608206 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54dcd3-7df7-4f14-8f42-359b6c41004a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:58.623073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-cd54dcd3-7df7-4f14-8f42-359b6c41004a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:27:58.624184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 574/1165] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:27:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:58.630500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5351-8d8e-4619-8e80-e08640ea7dde admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.640686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5351-8d8e-4619-8e80-e08640ea7dde admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.645413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d470a2-7f0d-4919-999a-9dd4acc5e721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.646055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d470a2-7f0d-4919-999a-9dd4acc5e721 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.646339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d470a2-7f0d-4919-999a-9dd4acc5e721 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.646610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d470a2-7f0d-4919-999a-9dd4acc5e721 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.647329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d470a2-7f0d-4919-999a-9dd4acc5e721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:58.647628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d470a2-7f0d-4919-999a-9dd4acc5e721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:58.649230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d470a2-7f0d-4919-999a-9dd4acc5e721 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:58.660293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 592/1166] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:27:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:58.666925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54dcd3-7df7-4f14-8f42-359b6c41004a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.677379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54dcd3-7df7-4f14-8f42-359b6c41004a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.682621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dd254-195f-43ec-8021-3c7f82b4c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.683426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dd254-195f-43ec-8021-3c7f82b4c097 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.683758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dd254-195f-43ec-8021-3c7f82b4c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.684014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dd254-195f-43ec-8021-3c7f82b4c097 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.691792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481dd254-195f-43ec-8021-3c7f82b4c097 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:58.694635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481dd254-195f-43ec-8021-3c7f82b4c097 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:58.708101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-481dd254-195f-43ec-8021-3c7f82b4c097 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:27:58.709364 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 575/1167] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:27:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:27:58.716130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d470a2-7f0d-4919-999a-9dd4acc5e721 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.726605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d470a2-7f0d-4919-999a-9dd4acc5e721 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.731438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1314eb-18a7-4368-9f71-66a64389f454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.732095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1314eb-18a7-4368-9f71-66a64389f454 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.732404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1314eb-18a7-4368-9f71-66a64389f454 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.735394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1314eb-18a7-4368-9f71-66a64389f454 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.735394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1314eb-18a7-4368-9f71-66a64389f454 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:27:58.735394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1314eb-18a7-4368-9f71-66a64389f454 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:58.735680 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1314eb-18a7-4368-9f71-66a64389f454 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:58.748623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 593/1168] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:27:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:27:58.755552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dd254-195f-43ec-8021-3c7f82b4c097 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:58.768154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dd254-195f-43ec-8021-3c7f82b4c097 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:58.772776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b8ecd-e33c-41a0-a17e-7c6f0a0a3e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:58.773656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b8ecd-e33c-41a0-a17e-7c6f0a0a3e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:58.773937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b8ecd-e33c-41a0-a17e-7c6f0a0a3e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:58.774212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b8ecd-e33c-41a0-a17e-7c6f0a0a3e95 admin admin] PATH_INFO: `/v3/projects/a605db043af542fd87b9365bb010b38d/users/3ef904ebfd2c4372b169ba7804278f19/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:58.776331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b8ecd-e33c-41a0-a17e-7c6f0a0a3e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a605db043af542fd87b9365bb010b38d, user_id=3ef904ebfd2c4372b169ba7804278f19, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:58.779087 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b8ecd-e33c-41a0-a17e-7c6f0a0a3e95 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:58.932429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 576/1169] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 04:27:58 2021] PUT /identity/v3/projects/a605db043af542fd87b9365bb010b38d/users/3ef904ebfd2c4372b169ba7804278f19/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:28:01.103399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014c9d-cb6e-446d-8110-9751fd088b15 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.103899 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014c9d-cb6e-446d-8110-9751fd088b15 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.103899 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014c9d-cb6e-446d-8110-9751fd088b15 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.105645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 594/1170] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:28:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:01.111506 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a6098-8039-4586-9415-e7b8642d2754 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.117096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a6098-8039-4586-9415-e7b8642d2754 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.117096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a6098-8039-4586-9415-e7b8642d2754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.129112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-376a6098-8039-4586-9415-e7b8642d2754 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:01.130286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-376a6098-8039-4586-9415-e7b8642d2754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:01.199877 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 577/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:28:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:01.226515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014c9d-cb6e-446d-8110-9751fd088b15 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.238877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014c9d-cb6e-446d-8110-9751fd088b15 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.243415 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c5374-30f1-4af9-a115-675749f891b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.244405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c5374-30f1-4af9-a115-675749f891b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.244590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c5374-30f1-4af9-a115-675749f891b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.244799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c5374-30f1-4af9-a115-675749f891b2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.255211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c5374-30f1-4af9-a115-675749f891b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:28:01.262565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-035c5374-30f1-4af9-a115-675749f891b2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:28:01.263756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 595/1172] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:28:01.270765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a6098-8039-4586-9415-e7b8642d2754 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.280547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a6098-8039-4586-9415-e7b8642d2754 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.285205 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd27e9-8530-49af-ba81-9097a31ef759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.285867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd27e9-8530-49af-ba81-9097a31ef759 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.286155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd27e9-8530-49af-ba81-9097a31ef759 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.286434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd27e9-8530-49af-ba81-9097a31ef759 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.287184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd27e9-8530-49af-ba81-9097a31ef759 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:01.287492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd27e9-8530-49af-ba81-9097a31ef759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.289148 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd27e9-8530-49af-ba81-9097a31ef759 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.298060 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 578/1173] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:28:01.304550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c5374-30f1-4af9-a115-675749f891b2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.314561 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c5374-30f1-4af9-a115-675749f891b2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.319546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa6e51-849e-4b71-93d2-8c9d0d358288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.320307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa6e51-849e-4b71-93d2-8c9d0d358288 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.320620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa6e51-849e-4b71-93d2-8c9d0d358288 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.320894 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa6e51-849e-4b71-93d2-8c9d0d358288 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.330960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa6e51-849e-4b71-93d2-8c9d0d358288 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.332825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa6e51-849e-4b71-93d2-8c9d0d358288 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.350270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-79aa6e51-849e-4b71-93d2-8c9d0d358288 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:28:01.351506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 596/1174] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:28:01.358895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd27e9-8530-49af-ba81-9097a31ef759 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.368852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd27e9-8530-49af-ba81-9097a31ef759 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.373640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58aab-ba44-4a7c-8277-ed1d459797ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.374307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58aab-ba44-4a7c-8277-ed1d459797ba admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.374592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58aab-ba44-4a7c-8277-ed1d459797ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.374867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58aab-ba44-4a7c-8277-ed1d459797ba admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.375609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc58aab-ba44-4a7c-8277-ed1d459797ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:01.375913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc58aab-ba44-4a7c-8277-ed1d459797ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.377637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc58aab-ba44-4a7c-8277-ed1d459797ba admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.391298 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 579/1175] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:28:01.398395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa6e51-849e-4b71-93d2-8c9d0d358288 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.408341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa6e51-849e-4b71-93d2-8c9d0d358288 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.413246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2c6f-f214-4f3c-8249-450099f6d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.414034 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2c6f-f214-4f3c-8249-450099f6d449 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.414314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2c6f-f214-4f3c-8249-450099f6d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.414590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2c6f-f214-4f3c-8249-450099f6d449 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.422193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2c6f-f214-4f3c-8249-450099f6d449 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.424345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2c6f-f214-4f3c-8249-450099f6d449 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.438360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-767d2c6f-f214-4f3c-8249-450099f6d449 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:28:01.439552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 597/1176] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:28:01.446601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58aab-ba44-4a7c-8277-ed1d459797ba admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.456739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58aab-ba44-4a7c-8277-ed1d459797ba admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.462014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7b95-28bc-400a-a4c9-8bc6a544e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.462669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7b95-28bc-400a-a4c9-8bc6a544e4ad admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.462991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7b95-28bc-400a-a4c9-8bc6a544e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.463265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7b95-28bc-400a-a4c9-8bc6a544e4ad admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.464100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da7b95-28bc-400a-a4c9-8bc6a544e4ad admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:01.464438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da7b95-28bc-400a-a4c9-8bc6a544e4ad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.466313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da7b95-28bc-400a-a4c9-8bc6a544e4ad admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.483805 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 580/1177] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:28:01.490281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2c6f-f214-4f3c-8249-450099f6d449 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.500087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2c6f-f214-4f3c-8249-450099f6d449 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.504645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06b6ec-a3be-4b36-a822-31f00b337e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.505275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b6ec-a3be-4b36-a822-31f00b337e35 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.505558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b6ec-a3be-4b36-a822-31f00b337e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.505834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b6ec-a3be-4b36-a822-31f00b337e35 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.514311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06b6ec-a3be-4b36-a822-31f00b337e35 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.516065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06b6ec-a3be-4b36-a822-31f00b337e35 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.526812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 598/1178] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:01.533659 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7b95-28bc-400a-a4c9-8bc6a544e4ad admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.544502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7b95-28bc-400a-a4c9-8bc6a544e4ad admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.549269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797baa29-6c16-49db-becc-ec177a65ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.550051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797baa29-6c16-49db-becc-ec177a65ff3c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.550333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797baa29-6c16-49db-becc-ec177a65ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.550610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797baa29-6c16-49db-becc-ec177a65ff3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.562220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797baa29-6c16-49db-becc-ec177a65ff3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.564069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797baa29-6c16-49db-becc-ec177a65ff3c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.581295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-797baa29-6c16-49db-becc-ec177a65ff3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:28:01.582481 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 581/1179] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:28:01.589118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06b6ec-a3be-4b36-a822-31f00b337e35 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.598251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06b6ec-a3be-4b36-a822-31f00b337e35 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.605402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046db7cd-a29d-4309-9260-977074077c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.606114 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db7cd-a29d-4309-9260-977074077c05 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.606396 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db7cd-a29d-4309-9260-977074077c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.606678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db7cd-a29d-4309-9260-977074077c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.607392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046db7cd-a29d-4309-9260-977074077c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:01.607691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046db7cd-a29d-4309-9260-977074077c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.615265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046db7cd-a29d-4309-9260-977074077c05 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.621582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 599/1180] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:28:01.627900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797baa29-6c16-49db-becc-ec177a65ff3c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.638310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797baa29-6c16-49db-becc-ec177a65ff3c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.642904 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450530b-5488-4d84-97b1-837b4198a702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.643701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450530b-5488-4d84-97b1-837b4198a702 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.644501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450530b-5488-4d84-97b1-837b4198a702 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.644501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450530b-5488-4d84-97b1-837b4198a702 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.651259 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450530b-5488-4d84-97b1-837b4198a702 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.653278 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450530b-5488-4d84-97b1-837b4198a702 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.666760 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING keystone.server.flask.application [None req-0450530b-5488-4d84-97b1-837b4198a702 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:28:01.667971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 582/1181] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:28:01.674693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046db7cd-a29d-4309-9260-977074077c05 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.685306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046db7cd-a29d-4309-9260-977074077c05 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.689933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d89571-6b95-447a-bea8-8b19dae025fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.690650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d89571-6b95-447a-bea8-8b19dae025fe admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.690934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d89571-6b95-447a-bea8-8b19dae025fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.691208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d89571-6b95-447a-bea8-8b19dae025fe admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.692004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d89571-6b95-447a-bea8-8b19dae025fe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:01.692310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d89571-6b95-447a-bea8-8b19dae025fe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.694869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d89571-6b95-447a-bea8-8b19dae025fe admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.707691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 600/1182] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:28:01.714478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450530b-5488-4d84-97b1-837b4198a702 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:01.725213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450530b-5488-4d84-97b1-837b4198a702 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:01.729836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff74ba-4c8b-48d8-9564-2d99d1de494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:01.730470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff74ba-4c8b-48d8-9564-2d99d1de494b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:01.730871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff74ba-4c8b-48d8-9564-2d99d1de494b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:01.731017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff74ba-4c8b-48d8-9564-2d99d1de494b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:01.731841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff74ba-4c8b-48d8-9564-2d99d1de494b admin admin] RBAC: Adding query filter params (role.id=7f4a5a2bd63941a9bab25565091ffe74, scope.project.id=a605db043af542fd87b9365bb010b38d, user.id=3ef904ebfd2c4372b169ba7804278f19) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:01.732153 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff74ba-4c8b-48d8-9564-2d99d1de494b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:01.734056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff74ba-4c8b-48d8-9564-2d99d1de494b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:01.740101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 583/1183] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 04:28:01 2021] GET /identity/v3/role_assignments?user.id=3ef904ebfd2c4372b169ba7804278f19&scope.project.id=a605db043af542fd87b9365bb010b38d&role.id=7f4a5a2bd63941a9bab25565091ffe74 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:28:03.965543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92661d9d-1c08-45dc-9e3c-ae36633dad31 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:03.966056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92661d9d-1c08-45dc-9e3c-ae36633dad31 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:03.966056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92661d9d-1c08-45dc-9e3c-ae36633dad31 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:03.967798 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 601/1184] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:28:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:03.978492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb901d6-2f54-4ab5-bc47-6d70576e7106 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:03.979034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb901d6-2f54-4ab5-bc47-6d70576e7106 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:03.979208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb901d6-2f54-4ab5-bc47-6d70576e7106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:03.997203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3eb901d6-2f54-4ab5-bc47-6d70576e7106 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:03.998395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3eb901d6-2f54-4ab5-bc47-6d70576e7106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:04.006980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 584/1185] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:28:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:04.030515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92661d9d-1c08-45dc-9e3c-ae36633dad31 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:04.044174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92661d9d-1c08-45dc-9e3c-ae36633dad31 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:04.048735 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefbc95-e144-43f3-8a89-8e02579c8d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:04.049529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefbc95-e144-43f3-8a89-8e02579c8d05 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:04.049810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefbc95-e144-43f3-8a89-8e02579c8d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:04.050084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefbc95-e144-43f3-8a89-8e02579c8d05 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:04.050738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefbc95-e144-43f3-8a89-8e02579c8d05 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:04.052341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefbc95-e144-43f3-8a89-8e02579c8d05 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:04.064026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-abefbc95-e144-43f3-8a89-8e02579c8d05 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:28:04.065261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 602/1186] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 04:28:04 2021] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:28:04.074311 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb901d6-2f54-4ab5-bc47-6d70576e7106 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:04.083346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb901d6-2f54-4ab5-bc47-6d70576e7106 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:04.088005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94f5ba-f3ed-4f29-a010-a867e84fcd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:04.088697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94f5ba-f3ed-4f29-a010-a867e84fcd91 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:04.088980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94f5ba-f3ed-4f29-a010-a867e84fcd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:04.089254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94f5ba-f3ed-4f29-a010-a867e84fcd91 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:04.089969 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94f5ba-f3ed-4f29-a010-a867e84fcd91 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:04.090286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94f5ba-f3ed-4f29-a010-a867e84fcd91 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:04.091873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94f5ba-f3ed-4f29-a010-a867e84fcd91 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:04.096793 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 585/1187] 10.222.0.25 () {56 vars in 1138 bytes} [Fri Aug 27 04:28:04 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:28:04.103122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefbc95-e144-43f3-8a89-8e02579c8d05 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:04.113718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefbc95-e144-43f3-8a89-8e02579c8d05 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:04.118947 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34248624-df97-498b-867c-85cd24c9fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:04.121079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34248624-df97-498b-867c-85cd24c9fa38 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:04.121079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34248624-df97-498b-867c-85cd24c9fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:04.121079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34248624-df97-498b-867c-85cd24c9fa38 admin admin] PATH_INFO: `/v3/services` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:04.121079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34248624-df97-498b-867c-85cd24c9fa38 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:04.121417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34248624-df97-498b-867c-85cd24c9fa38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:04.122875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34248624-df97-498b-867c-85cd24c9fa38 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:04.127641 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 603/1188] 10.222.0.25 () {56 vars in 1138 bytes} [Fri Aug 27 04:28:04 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:28:06.301716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14948c-a0b5-4a19-8121-cdb5cbfd854b None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:06.302290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14948c-a0b5-4a19-8121-cdb5cbfd854b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:06.302290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14948c-a0b5-4a19-8121-cdb5cbfd854b None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:06.304589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 586/1189] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:28:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:06.310788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a13ea-b8b8-41c1-af46-6e82cff3bebc None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:06.311199 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a13ea-b8b8-41c1-af46-6e82cff3bebc None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:06.311345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a13ea-b8b8-41c1-af46-6e82cff3bebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:06.329257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-c43a13ea-b8b8-41c1-af46-6e82cff3bebc None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:06.330457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c43a13ea-b8b8-41c1-af46-6e82cff3bebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:06.338257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 604/1190] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:28:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:06.361914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14948c-a0b5-4a19-8121-cdb5cbfd854b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:06.374605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14948c-a0b5-4a19-8121-cdb5cbfd854b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:06.378979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03f6ad-fe7f-41b5-a6f4-4e8776f43cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:06.379618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03f6ad-fe7f-41b5-a6f4-4e8776f43cac admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:06.379890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03f6ad-fe7f-41b5-a6f4-4e8776f43cac admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:06.380155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03f6ad-fe7f-41b5-a6f4-4e8776f43cac admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:06.380934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03f6ad-fe7f-41b5-a6f4-4e8776f43cac admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:06.383239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03f6ad-fe7f-41b5-a6f4-4e8776f43cac admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:06.480678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 587/1191] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 04:28:06 2021] POST /identity/v3/services => generated 246 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:28:08.689992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acff942-d7dd-432f-823c-0cad888b23f8 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:08.690516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acff942-d7dd-432f-823c-0cad888b23f8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:08.690516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acff942-d7dd-432f-823c-0cad888b23f8 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:08.692323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 605/1192] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:28:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:08.698872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a18b6-aeca-45dc-9045-71000bf1aa6a None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:08.699287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a18b6-aeca-45dc-9045-71000bf1aa6a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:08.702120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a18b6-aeca-45dc-9045-71000bf1aa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:08.717381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b41a18b6-aeca-45dc-9045-71000bf1aa6a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:08.718571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b41a18b6-aeca-45dc-9045-71000bf1aa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:08.735465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 588/1193] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:28:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:08.759179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acff942-d7dd-432f-823c-0cad888b23f8 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:08.771157 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acff942-d7dd-432f-823c-0cad888b23f8 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:08.776002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92112-17d4-485e-b8f6-381706f52e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:08.776808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92112-17d4-485e-b8f6-381706f52e56 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:08.777088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92112-17d4-485e-b8f6-381706f52e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:08.777357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92112-17d4-485e-b8f6-381706f52e56 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:08.777997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92112-17d4-485e-b8f6-381706f52e56 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:08.779613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92112-17d4-485e-b8f6-381706f52e56 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:08.790298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-4be92112-17d4-485e-b8f6-381706f52e56 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:28:08.791661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 606/1194] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 04:28:08 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:28:08.798352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a18b6-aeca-45dc-9045-71000bf1aa6a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:08.807256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a18b6-aeca-45dc-9045-71000bf1aa6a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:08.811829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af5151-82d0-447f-9752-87283df9a46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:08.812514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af5151-82d0-447f-9752-87283df9a46f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:08.812795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af5151-82d0-447f-9752-87283df9a46f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:08.813105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af5151-82d0-447f-9752-87283df9a46f admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:08.813784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af5151-82d0-447f-9752-87283df9a46f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:08.814069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af5151-82d0-447f-9752-87283df9a46f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:08.815713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af5151-82d0-447f-9752-87283df9a46f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:08.821311 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 589/1195] 10.222.0.25 () {56 vars in 1138 bytes} [Fri Aug 27 04:28:08 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:28:08.827543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92112-17d4-485e-b8f6-381706f52e56 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:08.837925 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92112-17d4-485e-b8f6-381706f52e56 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:08.843456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb7571-9719-4018-b2a8-c8dfdd3358c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:08.844121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb7571-9719-4018-b2a8-c8dfdd3358c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:08.844440 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb7571-9719-4018-b2a8-c8dfdd3358c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:08.844722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb7571-9719-4018-b2a8-c8dfdd3358c3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:08.845513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb7571-9719-4018-b2a8-c8dfdd3358c3 admin admin] RBAC: Adding query filter params (interface=public, service_id=1e864f2d7d3b4222a2b79b4ab10589e1, region_id=RegionOne) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:08.845823 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb7571-9719-4018-b2a8-c8dfdd3358c3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:08.847419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb7571-9719-4018-b2a8-c8dfdd3358c3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:08.853154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 607/1196] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 04:28:08 2021] GET /identity/v3/endpoints?service_id=1e864f2d7d3b4222a2b79b4ab10589e1&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:28:08.859717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af5151-82d0-447f-9752-87283df9a46f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:08.869392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af5151-82d0-447f-9752-87283df9a46f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:08.874009 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830ceeb-f943-4387-a175-8ba8dcb783a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:08.874655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ceeb-f943-4387-a175-8ba8dcb783a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:08.874935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ceeb-f943-4387-a175-8ba8dcb783a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:08.875207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ceeb-f943-4387-a175-8ba8dcb783a9 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:08.875878 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830ceeb-f943-4387-a175-8ba8dcb783a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:08.877505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830ceeb-f943-4387-a175-8ba8dcb783a9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:08.885817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 590/1197] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:28:08 2021] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:28:11.095489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3c5e-a566-4f6c-9a71-dc341b7ba0bb None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:11.095995 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3c5e-a566-4f6c-9a71-dc341b7ba0bb None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:11.095995 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3c5e-a566-4f6c-9a71-dc341b7ba0bb None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:11.097735 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 608/1198] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:28:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:11.104049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac860c18-ac6e-4092-8487-d5d7061c8b6e None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:11.104524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac860c18-ac6e-4092-8487-d5d7061c8b6e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:11.104619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac860c18-ac6e-4092-8487-d5d7061c8b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:11.131659 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-ac860c18-ac6e-4092-8487-d5d7061c8b6e None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:11.132908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ac860c18-ac6e-4092-8487-d5d7061c8b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:11.141454 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 591/1199] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:28:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:11.166507 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3c5e-a566-4f6c-9a71-dc341b7ba0bb None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:11.180080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3c5e-a566-4f6c-9a71-dc341b7ba0bb None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:11.185032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f878e7-a403-4846-99ba-47f59b3f7676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:11.185836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f878e7-a403-4846-99ba-47f59b3f7676 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:11.186120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f878e7-a403-4846-99ba-47f59b3f7676 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:11.186413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f878e7-a403-4846-99ba-47f59b3f7676 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:11.187095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f878e7-a403-4846-99ba-47f59b3f7676 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:11.188774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f878e7-a403-4846-99ba-47f59b3f7676 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:11.200652 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING keystone.server.flask.application [None req-92f878e7-a403-4846-99ba-47f59b3f7676 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:28:11.201901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 609/1200] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 04:28:11 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:28:11.209280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac860c18-ac6e-4092-8487-d5d7061c8b6e None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:11.219824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac860c18-ac6e-4092-8487-d5d7061c8b6e None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:11.224400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ce728-c19a-4190-b8c3-785c9120be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:11.225554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ce728-c19a-4190-b8c3-785c9120be41 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:11.225832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ce728-c19a-4190-b8c3-785c9120be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:11.226105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ce728-c19a-4190-b8c3-785c9120be41 admin admin] PATH_INFO: `/v3/services` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:11.226838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ce728-c19a-4190-b8c3-785c9120be41 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:28:11.227140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ce728-c19a-4190-b8c3-785c9120be41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:11.228758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ce728-c19a-4190-b8c3-785c9120be41 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:11.234026 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 592/1201] 10.222.0.25 () {56 vars in 1138 bytes} [Fri Aug 27 04:28:11 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:28:11.241081 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f878e7-a403-4846-99ba-47f59b3f7676 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:11.252189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f878e7-a403-4846-99ba-47f59b3f7676 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:11.256869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68a862-e77e-4e82-99c9-d63bc9eaedd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:11.257508 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68a862-e77e-4e82-99c9-d63bc9eaedd1 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:11.257786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68a862-e77e-4e82-99c9-d63bc9eaedd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:11.258080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68a862-e77e-4e82-99c9-d63bc9eaedd1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:11.258794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68a862-e77e-4e82-99c9-d63bc9eaedd1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:11.260382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68a862-e77e-4e82-99c9-d63bc9eaedd1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:11.360255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 610/1202] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 04:28:11 2021] POST /identity/v3/endpoints => generated 331 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:35:56.867132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166acc7c-cb5c-4d83-b35f-2ff5a023d07c None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:35:56.890769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166acc7c-cb5c-4d83-b35f-2ff5a023d07c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:35:56.890769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166acc7c-cb5c-4d83-b35f-2ff5a023d07c None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:35:56.890769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 593/1203] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:35:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:35:56.891048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a51bc-9c0d-48c1-85bf-ab23236df905 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:35:56.891048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a51bc-9c0d-48c1-85bf-ab23236df905 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:35:56.891048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a51bc-9c0d-48c1-85bf-ab23236df905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:35:56.973881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-c37a51bc-9c0d-48c1-85bf-ab23236df905 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:35:56.974872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c37a51bc-9c0d-48c1-85bf-ab23236df905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:35:57.082746 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 611/1204] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:35:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:35:57.106960 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166acc7c-cb5c-4d83-b35f-2ff5a023d07c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:35:57.109066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-166acc7c-cb5c-4d83-b35f-2ff5a023d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:35:57.244179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166acc7c-cb5c-4d83-b35f-2ff5a023d07c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:35:57.341551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd79f1-54b2-4cb5-92ff-7d87f94282c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:35:57.342391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd79f1-54b2-4cb5-92ff-7d87f94282c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:35:57.342783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd79f1-54b2-4cb5-92ff-7d87f94282c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:35:57.343165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd79f1-54b2-4cb5-92ff-7d87f94282c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:35:57.344039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd79f1-54b2-4cb5-92ff-7d87f94282c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:35:57.346182 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd79f1-54b2-4cb5-92ff-7d87f94282c0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:35:57.376396 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 594/1205] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:35:57 2021] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:35:59.586767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cd86-65be-4017-a1c0-da6bcfc166f1 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:35:59.587351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cd86-65be-4017-a1c0-da6bcfc166f1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:35:59.587351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cd86-65be-4017-a1c0-da6bcfc166f1 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:35:59.589118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 612/1206] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:35:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:35:59.594955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae198fd-217b-4ea5-8a3c-9652da8cb220 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:35:59.595399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae198fd-217b-4ea5-8a3c-9652da8cb220 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:35:59.595512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae198fd-217b-4ea5-8a3c-9652da8cb220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:35:59.662778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7ae198fd-217b-4ea5-8a3c-9652da8cb220 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:35:59.664001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7ae198fd-217b-4ea5-8a3c-9652da8cb220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:35:59.755781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 595/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:35:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:35:59.808972 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9d41-2c05-4c47-b93b-b0db585b389d None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:35:59.809261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9d41-2c05-4c47-b93b-b0db585b389d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:35:59.809539 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9d41-2c05-4c47-b93b-b0db585b389d None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:35:59.811338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 613/1208] 10.222.0.25 () {54 vars in 964 bytes} [Fri Aug 27 04:35:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:35:59.817683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea00c04-c45e-43b2-a77c-7714e2442043 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:35:59.817980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea00c04-c45e-43b2-a77c-7714e2442043 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:35:59.818262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea00c04-c45e-43b2-a77c-7714e2442043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:35:59.890092 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-aea00c04-c45e-43b2-a77c-7714e2442043 None None] MFA Rules not processed for user `a95d2eadd8c7455bb70477e4522c74c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:35:59.891288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-aea00c04-c45e-43b2-a77c-7714e2442043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:35:59.965592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 596/1209] 10.222.0.25 () {58 vars in 1062 bytes} [Fri Aug 27 04:35:59 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:35:59.974875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9d41-2c05-4c47-b93b-b0db585b389d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:35:59.977132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-32bf9d41-2c05-4c47-b93b-b0db585b389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:00.077444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9d41-2c05-4c47-b93b-b0db585b389d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:00.146488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41d3c3-2ed1-4d1d-8727-f8180d1f4123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:00.147052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d3c3-2ed1-4d1d-8727-f8180d1f4123 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:00.147329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d3c3-2ed1-4d1d-8727-f8180d1f4123 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:00.147624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d3c3-2ed1-4d1d-8727-f8180d1f4123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:00.149271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ae41d3c3-2ed1-4d1d-8727-f8180d1f4123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:00.252505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41d3c3-2ed1-4d1d-8727-f8180d1f4123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:00.253928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41d3c3-2ed1-4d1d-8727-f8180d1f4123 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:00.271502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 614/1210] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:35:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:02.675146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d535-5936-4b3f-acc7-d65b48347d14 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:02.675710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d535-5936-4b3f-acc7-d65b48347d14 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:02.675710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d535-5936-4b3f-acc7-d65b48347d14 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:02.678599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 597/1211] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:02.683782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc01098-241f-42d6-9155-88bccd12506c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:02.684231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc01098-241f-42d6-9155-88bccd12506c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:02.684333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc01098-241f-42d6-9155-88bccd12506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:02.752470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-efc01098-241f-42d6-9155-88bccd12506c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:02.753710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-efc01098-241f-42d6-9155-88bccd12506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:02.857584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 615/1212] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:02.896032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2d535-5936-4b3f-acc7-d65b48347d14 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:02.898174 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-35d2d535-5936-4b3f-acc7-d65b48347d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:02.997710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2d535-5936-4b3f-acc7-d65b48347d14 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:03.070389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8c56d-41d1-4144-bc10-42c4631c2d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:03.071032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8c56d-41d1-4144-bc10-42c4631c2d3b service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:03.071303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8c56d-41d1-4144-bc10-42c4631c2d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:03.071569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8c56d-41d1-4144-bc10-42c4631c2d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:03.073211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1eb8c56d-41d1-4144-bc10-42c4631c2d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:03.179499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8c56d-41d1-4144-bc10-42c4631c2d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:03.180983 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8c56d-41d1-4144-bc10-42c4631c2d3b service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:03.199051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 598/1213] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:05.882590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c3e6c-1edb-4d7a-b376-f16be7b6c658 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:05.883501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c3e6c-1edb-4d7a-b376-f16be7b6c658 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:05.883501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c3e6c-1edb-4d7a-b376-f16be7b6c658 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:05.885028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 616/1214] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:05.891156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8a6a-f168-44fd-81f4-509009131937 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:05.891557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8a6a-f168-44fd-81f4-509009131937 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:05.891723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8a6a-f168-44fd-81f4-509009131937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:05.954847 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-8f6f8a6a-f168-44fd-81f4-509009131937 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:05.955973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8f6f8a6a-f168-44fd-81f4-509009131937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:06.050973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 599/1215] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:06.087119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c3e6c-1edb-4d7a-b376-f16be7b6c658 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:06.088666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-337c3e6c-1edb-4d7a-b376-f16be7b6c658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:06.209712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c3e6c-1edb-4d7a-b376-f16be7b6c658 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:06.298855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e7e95-5aee-43d1-ae54-913bc2f78b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:06.299708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e7e95-5aee-43d1-ae54-913bc2f78b18 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:06.299987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e7e95-5aee-43d1-ae54-913bc2f78b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:06.300259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e7e95-5aee-43d1-ae54-913bc2f78b18 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:06.310276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e7e95-5aee-43d1-ae54-913bc2f78b18 admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:06.312338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e7e95-5aee-43d1-ae54-913bc2f78b18 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:06.314090 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 617/1216] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:36:06 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:36:06.340476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13503d-7365-40b6-9cca-4e72b75a9a95 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:06.340775 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13503d-7365-40b6-9cca-4e72b75a9a95 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:06.341055 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13503d-7365-40b6-9cca-4e72b75a9a95 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:06.342896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 600/1217] 10.222.0.25 () {54 vars in 964 bytes} [Fri Aug 27 04:36:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:06.348994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52853da-b6f2-487d-8488-b9a2227905b2 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:06.349278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52853da-b6f2-487d-8488-b9a2227905b2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:06.349554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52853da-b6f2-487d-8488-b9a2227905b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:06.422467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e52853da-b6f2-487d-8488-b9a2227905b2 None None] MFA Rules not processed for user `a95d2eadd8c7455bb70477e4522c74c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:06.423712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e52853da-b6f2-487d-8488-b9a2227905b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:06.512643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 618/1218] 10.222.0.25 () {58 vars in 1062 bytes} [Fri Aug 27 04:36:06 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:06.521916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13503d-7365-40b6-9cca-4e72b75a9a95 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:06.523440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5c13503d-7365-40b6-9cca-4e72b75a9a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:06.628162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13503d-7365-40b6-9cca-4e72b75a9a95 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:06.697904 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d17e-0879-4d9c-abd4-d87aa629788e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:06.698547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d17e-0879-4d9c-abd4-d87aa629788e service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:06.698825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d17e-0879-4d9c-abd4-d87aa629788e service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:06.699099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d17e-0879-4d9c-abd4-d87aa629788e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:06.700720 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-33f0d17e-0879-4d9c-abd4-d87aa629788e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:06.804412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d17e-0879-4d9c-abd4-d87aa629788e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:06.806165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d17e-0879-4d9c-abd4-d87aa629788e service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:06.832113 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 601/1219] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:10.184029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab85857-229e-4522-bf9d-e0e153089ba1 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:10.184592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab85857-229e-4522-bf9d-e0e153089ba1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:10.184715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab85857-229e-4522-bf9d-e0e153089ba1 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:10.186448 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 619/1220] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:10.192632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e937-fcb2-457d-96c3-3893eac92b6d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:10.193011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e937-fcb2-457d-96c3-3893eac92b6d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:10.193181 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e937-fcb2-457d-96c3-3893eac92b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:10.254885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-afb5e937-fcb2-457d-96c3-3893eac92b6d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:10.261628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-afb5e937-fcb2-457d-96c3-3893eac92b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:10.347980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 602/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:10.381098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab85857-229e-4522-bf9d-e0e153089ba1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:10.383113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-3ab85857-229e-4522-bf9d-e0e153089ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:10.503833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab85857-229e-4522-bf9d-e0e153089ba1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:10.593605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d963c11-008e-461c-93c9-9eb14a99ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:10.594515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d963c11-008e-461c-93c9-9eb14a99ea7d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:10.594797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d963c11-008e-461c-93c9-9eb14a99ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:10.595067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d963c11-008e-461c-93c9-9eb14a99ea7d admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:10.604640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d963c11-008e-461c-93c9-9eb14a99ea7d admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:10.606821 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d963c11-008e-461c-93c9-9eb14a99ea7d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:10.608533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 620/1222] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:36:10 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:36:10.620919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5e937-fcb2-457d-96c3-3893eac92b6d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:10.622146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-afb5e937-fcb2-457d-96c3-3893eac92b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:10.710225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5e937-fcb2-457d-96c3-3893eac92b6d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:10.780125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fb3d6-e42d-4500-8b0c-88a0df4ea576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:10.780703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb3d6-e42d-4500-8b0c-88a0df4ea576 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:10.780981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb3d6-e42d-4500-8b0c-88a0df4ea576 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:10.781247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb3d6-e42d-4500-8b0c-88a0df4ea576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:10.782831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8b5fb3d6-e42d-4500-8b0c-88a0df4ea576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:10.885256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fb3d6-e42d-4500-8b0c-88a0df4ea576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:10.886692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fb3d6-e42d-4500-8b0c-88a0df4ea576 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:10.904517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 603/1223] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:14.180321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedea2b-4beb-4584-9b5c-f7c69d970056 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:14.180932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedea2b-4beb-4584-9b5c-f7c69d970056 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:14.180932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedea2b-4beb-4584-9b5c-f7c69d970056 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:14.182667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 621/1224] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:14.188712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f66a18-4a6b-41f4-9a3b-287b3cf6ddec None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:14.189149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f66a18-4a6b-41f4-9a3b-287b3cf6ddec None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:14.189401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f66a18-4a6b-41f4-9a3b-287b3cf6ddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:14.253174 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-f5f66a18-4a6b-41f4-9a3b-287b3cf6ddec None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:14.254365 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f5f66a18-4a6b-41f4-9a3b-287b3cf6ddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:14.346446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 604/1225] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:14.383610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedea2b-4beb-4584-9b5c-f7c69d970056 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:14.385227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-daedea2b-4beb-4584-9b5c-f7c69d970056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:14.493910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedea2b-4beb-4584-9b5c-f7c69d970056 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:14.566901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43959d-c1df-4243-b668-8f1702020fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:14.567565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43959d-c1df-4243-b668-8f1702020fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:14.567846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43959d-c1df-4243-b668-8f1702020fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:14.568126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43959d-c1df-4243-b668-8f1702020fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:14.569909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8b43959d-c1df-4243-b668-8f1702020fe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:14.675365 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43959d-c1df-4243-b668-8f1702020fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:14.676840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43959d-c1df-4243-b668-8f1702020fe2 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:14.695051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 622/1226] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:16.931200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e56c6-7fd9-4b59-9fb7-c4e4940b45d9 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:16.931752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e56c6-7fd9-4b59-9fb7-c4e4940b45d9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:16.931752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e56c6-7fd9-4b59-9fb7-c4e4940b45d9 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:16.933567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 605/1227] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:16.939648 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a529e-2588-426f-9726-470f67536854 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:16.940108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a529e-2588-426f-9726-470f67536854 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:16.940201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a529e-2588-426f-9726-470f67536854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:17.016484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-496a529e-2588-426f-9726-470f67536854 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:17.017614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-496a529e-2588-426f-9726-470f67536854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:17.111523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 623/1228] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:17.150453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e56c6-7fd9-4b59-9fb7-c4e4940b45d9 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:17.151984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-bb9e56c6-7fd9-4b59-9fb7-c4e4940b45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:17.257403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e56c6-7fd9-4b59-9fb7-c4e4940b45d9 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:17.334598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a6060-e005-4327-a524-bba89e025ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:17.335788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a6060-e005-4327-a524-bba89e025ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:17.336075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a6060-e005-4327-a524-bba89e025ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:17.336369 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a6060-e005-4327-a524-bba89e025ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:17.338013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6f8a6060-e005-4327-a524-bba89e025ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:17.445943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a6060-e005-4327-a524-bba89e025ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:17.447401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a6060-e005-4327-a524-bba89e025ec9 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:17.465485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 606/1229] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:19.703346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f12ef9-6b46-4080-8d23-f1f4780fce33 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:19.703834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f12ef9-6b46-4080-8d23-f1f4780fce33 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:19.703966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f12ef9-6b46-4080-8d23-f1f4780fce33 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:19.705824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 624/1230] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:19.711890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0ed1c-c320-448b-8a1b-1bf8cb38107f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:19.712318 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0ed1c-c320-448b-8a1b-1bf8cb38107f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:19.712523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0ed1c-c320-448b-8a1b-1bf8cb38107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:19.781619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e5d0ed1c-c320-448b-8a1b-1bf8cb38107f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:19.782840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e5d0ed1c-c320-448b-8a1b-1bf8cb38107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:19.876695 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 607/1231] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:19.909816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f12ef9-6b46-4080-8d23-f1f4780fce33 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:19.911248 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-38f12ef9-6b46-4080-8d23-f1f4780fce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:20.041990 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f12ef9-6b46-4080-8d23-f1f4780fce33 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:20.132951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bab95-afe0-43f1-9510-70844d99da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:20.133868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bab95-afe0-43f1-9510-70844d99da76 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:20.134088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bab95-afe0-43f1-9510-70844d99da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:20.134358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bab95-afe0-43f1-9510-70844d99da76 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:20.143781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bab95-afe0-43f1-9510-70844d99da76 admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:20.145977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bab95-afe0-43f1-9510-70844d99da76 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:20.147757 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 625/1232] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:36:19 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:36:20.160886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0ed1c-c320-448b-8a1b-1bf8cb38107f None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:20.162290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e5d0ed1c-c320-448b-8a1b-1bf8cb38107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:20.250355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0ed1c-c320-448b-8a1b-1bf8cb38107f None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:20.327425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd8c6f-c840-4d11-9f3f-30fae9aecc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:20.328077 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd8c6f-c840-4d11-9f3f-30fae9aecc43 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:20.328384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd8c6f-c840-4d11-9f3f-30fae9aecc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:20.328663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd8c6f-c840-4d11-9f3f-30fae9aecc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:20.330283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4ebd8c6f-c840-4d11-9f3f-30fae9aecc43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:20.434811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd8c6f-c840-4d11-9f3f-30fae9aecc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:20.436187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd8c6f-c840-4d11-9f3f-30fae9aecc43 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:20.453555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 608/1233] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:23.087333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883f7d0-ddcd-4e41-9675-73b504e34344 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:23.087840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883f7d0-ddcd-4e41-9675-73b504e34344 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:23.087840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883f7d0-ddcd-4e41-9675-73b504e34344 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:23.089642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 626/1234] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:23.098469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f15a-d92c-4540-bb1c-2d89cf6b917c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:23.098975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f15a-d92c-4540-bb1c-2d89cf6b917c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:23.099068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f15a-d92c-4540-bb1c-2d89cf6b917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:23.167156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2369f15a-d92c-4540-bb1c-2d89cf6b917c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:23.168395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2369f15a-d92c-4540-bb1c-2d89cf6b917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:23.266212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 609/1235] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:23.304292 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883f7d0-ddcd-4e41-9675-73b504e34344 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:23.305865 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7883f7d0-ddcd-4e41-9675-73b504e34344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:23.408756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883f7d0-ddcd-4e41-9675-73b504e34344 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:23.480132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4caad-3720-481d-9fc1-5790f0d82df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:23.480816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4caad-3720-481d-9fc1-5790f0d82df8 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:23.481099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4caad-3720-481d-9fc1-5790f0d82df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:23.481376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4caad-3720-481d-9fc1-5790f0d82df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:23.483027 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-76d4caad-3720-481d-9fc1-5790f0d82df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:23.589124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4caad-3720-481d-9fc1-5790f0d82df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:23.590561 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4caad-3720-481d-9fc1-5790f0d82df8 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:23.608630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 627/1236] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:25.830922 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49b1c4-5d6c-4c4b-a936-5d1fa2809df3 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:25.831442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49b1c4-5d6c-4c4b-a936-5d1fa2809df3 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:25.831551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49b1c4-5d6c-4c4b-a936-5d1fa2809df3 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:25.833325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 610/1237] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:25.839401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1c09-55af-48d8-9e40-6b0ff250d28a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:25.839843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1c09-55af-48d8-9e40-6b0ff250d28a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:25.839962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1c09-55af-48d8-9e40-6b0ff250d28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:25.902791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-48ee1c09-55af-48d8-9e40-6b0ff250d28a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:25.904058 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-48ee1c09-55af-48d8-9e40-6b0ff250d28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:25.999528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 628/1238] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:26.040812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49b1c4-5d6c-4c4b-a936-5d1fa2809df3 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:26.042311 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1e49b1c4-5d6c-4c4b-a936-5d1fa2809df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:26.141588 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49b1c4-5d6c-4c4b-a936-5d1fa2809df3 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:26.209894 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe05d5-5c17-4bff-86fc-eb7816bc1e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:26.210522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe05d5-5c17-4bff-86fc-eb7816bc1e77 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:26.210798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe05d5-5c17-4bff-86fc-eb7816bc1e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:26.211067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe05d5-5c17-4bff-86fc-eb7816bc1e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:26.212687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-60fe05d5-5c17-4bff-86fc-eb7816bc1e77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:26.316687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe05d5-5c17-4bff-86fc-eb7816bc1e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:26.318072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe05d5-5c17-4bff-86fc-eb7816bc1e77 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:26.337030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 611/1239] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:29.232751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20e423-bc6c-4b85-9ee2-0b3fcc308be6 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:29.233339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20e423-bc6c-4b85-9ee2-0b3fcc308be6 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:29.233339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20e423-bc6c-4b85-9ee2-0b3fcc308be6 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:29.235195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 629/1240] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:29.241299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f90b0-745e-46f2-b1ba-f9edd25c26e2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:29.241740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f90b0-745e-46f2-b1ba-f9edd25c26e2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:29.241847 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f90b0-745e-46f2-b1ba-f9edd25c26e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:29.314651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d25f90b0-745e-46f2-b1ba-f9edd25c26e2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:29.315836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d25f90b0-745e-46f2-b1ba-f9edd25c26e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:29.418371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 612/1241] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:29.456811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20e423-bc6c-4b85-9ee2-0b3fcc308be6 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:29.458965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ae20e423-bc6c-4b85-9ee2-0b3fcc308be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:29.551274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20e423-bc6c-4b85-9ee2-0b3fcc308be6 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:29.555290 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ea870-8f5f-4f87-946e-1a362297b89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:29.555926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea870-8f5f-4f87-946e-1a362297b89b service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:29.556240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea870-8f5f-4f87-946e-1a362297b89b service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:29.556541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea870-8f5f-4f87-946e-1a362297b89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:29.565244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ea870-8f5f-4f87-946e-1a362297b89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:29.566662 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ea870-8f5f-4f87-946e-1a362297b89b service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:29.576709 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 630/1242] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:34.184517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805796ed-b82e-4215-9525-362a6b8eee05 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:34.185137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805796ed-b82e-4215-9525-362a6b8eee05 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:34.185137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805796ed-b82e-4215-9525-362a6b8eee05 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:34.186910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 613/1243] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:34.193166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840c11f-0a0b-4c2f-b53f-04d4c51c3a72 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:34.194470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840c11f-0a0b-4c2f-b53f-04d4c51c3a72 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:34.194470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840c11f-0a0b-4c2f-b53f-04d4c51c3a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:34.212279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-9840c11f-0a0b-4c2f-b53f-04d4c51c3a72 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:34.213598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9840c11f-0a0b-4c2f-b53f-04d4c51c3a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:34.221673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 631/1244] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:34.262415 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805796ed-b82e-4215-9525-362a6b8eee05 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:34.273870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805796ed-b82e-4215-9525-362a6b8eee05 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:34.277654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a0b99-8ccd-4b3d-841f-ec1bef205a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:34.278286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a0b99-8ccd-4b3d-841f-ec1bef205a0c service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:34.278563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a0b99-8ccd-4b3d-841f-ec1bef205a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:34.278836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a0b99-8ccd-4b3d-841f-ec1bef205a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:34.288037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a0b99-8ccd-4b3d-841f-ec1bef205a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:34.289514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a0b99-8ccd-4b3d-841f-ec1bef205a0c service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:34.298967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 614/1245] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:37.601175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2d33-7bba-4920-9627-618f5a4a0145 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:37.601780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2d33-7bba-4920-9627-618f5a4a0145 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:37.601780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2d33-7bba-4920-9627-618f5a4a0145 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:37.603538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 632/1246] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:37.610051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5513-20e8-4fc6-aefd-6b786bac9103 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:37.610624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5513-20e8-4fc6-aefd-6b786bac9103 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:37.610624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5513-20e8-4fc6-aefd-6b786bac9103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:37.630008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-57de5513-20e8-4fc6-aefd-6b786bac9103 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:37.631303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-57de5513-20e8-4fc6-aefd-6b786bac9103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:37.639747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 615/1247] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:37.679204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d2d33-7bba-4920-9627-618f5a4a0145 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:37.690190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d2d33-7bba-4920-9627-618f5a4a0145 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:37.695972 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f62f58-19c9-4c8d-9793-3b82d47ca72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:37.696672 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f62f58-19c9-4c8d-9793-3b82d47ca72c service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:37.696963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f62f58-19c9-4c8d-9793-3b82d47ca72c service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:37.697272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f62f58-19c9-4c8d-9793-3b82d47ca72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:37.706876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f62f58-19c9-4c8d-9793-3b82d47ca72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:37.708314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f62f58-19c9-4c8d-9793-3b82d47ca72c service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:37.718793 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 633/1248] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:42.269302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce051-d0f7-4d7a-8d12-cffd43ae1c57 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:42.269854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce051-d0f7-4d7a-8d12-cffd43ae1c57 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:42.269854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce051-d0f7-4d7a-8d12-cffd43ae1c57 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:42.271666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 616/1249] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:42.278071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acb20e-ac31-4ff3-8e0a-c81363f7ed9f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:42.278534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acb20e-ac31-4ff3-8e0a-c81363f7ed9f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:42.278623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acb20e-ac31-4ff3-8e0a-c81363f7ed9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:42.296734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-09acb20e-ac31-4ff3-8e0a-c81363f7ed9f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:42.297952 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-09acb20e-ac31-4ff3-8e0a-c81363f7ed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:42.306420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 634/1250] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:42.346352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fce051-d0f7-4d7a-8d12-cffd43ae1c57 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:42.348088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e4fce051-d0f7-4d7a-8d12-cffd43ae1c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:42.360778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fce051-d0f7-4d7a-8d12-cffd43ae1c57 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:42.364261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ca039-e6ea-4fb4-81d9-3b87d49e4ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:42.365506 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca039-e6ea-4fb4-81d9-3b87d49e4ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:42.365729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca039-e6ea-4fb4-81d9-3b87d49e4ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:42.366094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca039-e6ea-4fb4-81d9-3b87d49e4ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:42.375407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ca039-e6ea-4fb4-81d9-3b87d49e4ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:42.376902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ca039-e6ea-4fb4-81d9-3b87d49e4ed7 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:42.386994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 617/1251] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:47.408794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63a555-2287-4d36-9181-8babf18aeb19 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:47.409354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63a555-2287-4d36-9181-8babf18aeb19 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:47.409354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63a555-2287-4d36-9181-8babf18aeb19 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:47.411398 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 635/1252] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 04:36:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:47.417256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fca22-5fec-4a06-82a2-98f23b801df9 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:47.418128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fca22-5fec-4a06-82a2-98f23b801df9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:47.419737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fca22-5fec-4a06-82a2-98f23b801df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:47.491855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-590fca22-5fec-4a06-82a2-98f23b801df9 None None] MFA Rules not processed for user `3ef904ebfd2c4372b169ba7804278f19`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:47.493448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-590fca22-5fec-4a06-82a2-98f23b801df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:47.566749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 618/1253] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 04:36:47 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:52.008458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde430c-97ce-4f63-8e2b-30b8f41ea296 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:52.008959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde430c-97ce-4f63-8e2b-30b8f41ea296 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:52.008959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde430c-97ce-4f63-8e2b-30b8f41ea296 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:52.010698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 636/1254] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 04:36:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:52.016645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc104ec-2e3d-4470-a22d-690abc72a652 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:52.017084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc104ec-2e3d-4470-a22d-690abc72a652 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:52.017354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc104ec-2e3d-4470-a22d-690abc72a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:52.043247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-6dc104ec-2e3d-4470-a22d-690abc72a652 None None] MFA Rules not processed for user `3ef904ebfd2c4372b169ba7804278f19`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:52.044740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6dc104ec-2e3d-4470-a22d-690abc72a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:52.054137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 619/1255] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 04:36:52 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:53.628811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50ed4a-a231-488e-9528-3f360afc1281 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:53.629354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50ed4a-a231-488e-9528-3f360afc1281 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:53.629354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50ed4a-a231-488e-9528-3f360afc1281 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:53.631173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 637/1256] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 04:36:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:53.636864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f80ff-94c5-44a9-a5bb-021cf4ef5f23 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:53.637345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f80ff-94c5-44a9-a5bb-021cf4ef5f23 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:53.637454 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f80ff-94c5-44a9-a5bb-021cf4ef5f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:53.656141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-130f80ff-94c5-44a9-a5bb-021cf4ef5f23 None None] MFA Rules not processed for user `3ef904ebfd2c4372b169ba7804278f19`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:53.657397 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-130f80ff-94c5-44a9-a5bb-021cf4ef5f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:53.671549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 620/1257] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 04:36:53 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:36:57.470406 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79ad99-6cd4-47b7-a195-0c2ccbde1c3f None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:57.470969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79ad99-6cd4-47b7-a195-0c2ccbde1c3f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:57.470969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79ad99-6cd4-47b7-a195-0c2ccbde1c3f None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:57.472926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 638/1258] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:36:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:57.479571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd34f7-31f6-42f0-a98e-ff3f32704dd8 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:57.480521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd34f7-31f6-42f0-a98e-ff3f32704dd8 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:57.480812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd34f7-31f6-42f0-a98e-ff3f32704dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:57.501162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-84dd34f7-31f6-42f0-a98e-ff3f32704dd8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:57.502302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-84dd34f7-31f6-42f0-a98e-ff3f32704dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:57.510689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 621/1259] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:36:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:57.563550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a798ee-3156-4ddb-9637-0e673fa67799 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:57.564067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a798ee-3156-4ddb-9637-0e673fa67799 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:57.564479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a798ee-3156-4ddb-9637-0e673fa67799 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:57.566415 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 639/1260] 10.222.0.25 () {54 vars in 961 bytes} [Fri Aug 27 04:36:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:57.575116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f5f7-132e-4a60-a5f5-eb7608701c2d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:57.575515 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f5f7-132e-4a60-a5f5-eb7608701c2d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:57.575799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f5f7-132e-4a60-a5f5-eb7608701c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:57.625006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-f560f5f7-132e-4a60-a5f5-eb7608701c2d None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:57.626365 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f560f5f7-132e-4a60-a5f5-eb7608701c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:57.720022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 622/1261] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Aug 27 04:36:57 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:36:57.729837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a798ee-3156-4ddb-9637-0e673fa67799 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:57.744419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a798ee-3156-4ddb-9637-0e673fa67799 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:57.750274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec95840-4449-468a-b6c5-1e207aeaeb5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:57.751025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec95840-4449-468a-b6c5-1e207aeaeb5a service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:57.751462 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec95840-4449-468a-b6c5-1e207aeaeb5a service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:57.751795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec95840-4449-468a-b6c5-1e207aeaeb5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:57.761040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec95840-4449-468a-b6c5-1e207aeaeb5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:57.762761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec95840-4449-468a-b6c5-1e207aeaeb5a service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:57.779470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 640/1262] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:36:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:00.138814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f7b90-7788-4a80-b2df-86ece58d2431 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:00.139398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f7b90-7788-4a80-b2df-86ece58d2431 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:00.139398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f7b90-7788-4a80-b2df-86ece58d2431 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:00.141149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 623/1263] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:00.147929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e492a-91df-4f6f-aefe-c39f53d87836 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:00.148416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e492a-91df-4f6f-aefe-c39f53d87836 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:00.148595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e492a-91df-4f6f-aefe-c39f53d87836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:00.170086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d18e492a-91df-4f6f-aefe-c39f53d87836 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:00.171525 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d18e492a-91df-4f6f-aefe-c39f53d87836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:00.180377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 641/1264] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:00.230511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f7b90-7788-4a80-b2df-86ece58d2431 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:00.246139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f7b90-7788-4a80-b2df-86ece58d2431 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:00.252470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491205cf-6408-461f-a191-5ffcc30903e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:00.253305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491205cf-6408-461f-a191-5ffcc30903e0 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:00.253698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491205cf-6408-461f-a191-5ffcc30903e0 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:00.254088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491205cf-6408-461f-a191-5ffcc30903e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:00.264729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491205cf-6408-461f-a191-5ffcc30903e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:00.266586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491205cf-6408-461f-a191-5ffcc30903e0 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:00.279027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 624/1265] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:02.913848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28c71-b4de-4310-ae83-5f59ba1a01de None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:02.914959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28c71-b4de-4310-ae83-5f59ba1a01de None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:02.915521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28c71-b4de-4310-ae83-5f59ba1a01de None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:02.918172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 642/1266] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:02 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:02.925440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761aa3-8a75-407b-91fe-2dd4aef0904b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:02.925953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761aa3-8a75-407b-91fe-2dd4aef0904b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:02.926084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761aa3-8a75-407b-91fe-2dd4aef0904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:02.946134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c7761aa3-8a75-407b-91fe-2dd4aef0904b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:02.947707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c7761aa3-8a75-407b-91fe-2dd4aef0904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:02.955537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 625/1267] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:03.004314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c08c-c780-4cbe-b042-490874bc84c8 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:03.004758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c08c-c780-4cbe-b042-490874bc84c8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:03.005111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c08c-c780-4cbe-b042-490874bc84c8 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:03.006964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 643/1268] 10.222.0.25 () {54 vars in 961 bytes} [Fri Aug 27 04:37:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:03.012934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e43ea-a9aa-415f-916e-af52091a80b3 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:03.013299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e43ea-a9aa-415f-916e-af52091a80b3 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:03.013648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e43ea-a9aa-415f-916e-af52091a80b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:03.032980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e13e43ea-a9aa-415f-916e-af52091a80b3 None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:03.034176 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e13e43ea-a9aa-415f-916e-af52091a80b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:03.046226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 626/1269] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Aug 27 04:37:03 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:03.052425 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c08c-c780-4cbe-b042-490874bc84c8 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:03.066659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c08c-c780-4cbe-b042-490874bc84c8 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:03.072253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f44e4-eeb4-431f-9d27-7c812a1729b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:03.072931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f44e4-eeb4-431f-9d27-7c812a1729b1 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:03.073223 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f44e4-eeb4-431f-9d27-7c812a1729b1 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:03.073500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f44e4-eeb4-431f-9d27-7c812a1729b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:03.082025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f44e4-eeb4-431f-9d27-7c812a1729b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:03.084164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f44e4-eeb4-431f-9d27-7c812a1729b1 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:03.093872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 644/1270] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:05.562491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d1e19-e212-418a-95f2-b383824ad6a9 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:05.563143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d1e19-e212-418a-95f2-b383824ad6a9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:05.563143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d1e19-e212-418a-95f2-b383824ad6a9 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:05.564994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 627/1271] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:05.572460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf116f2-e112-44db-9d15-77579655d8f2 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:05.573144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf116f2-e112-44db-9d15-77579655d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:05.573328 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf116f2-e112-44db-9d15-77579655d8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:05.600393 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-fbf116f2-e112-44db-9d15-77579655d8f2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:05.602519 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-fbf116f2-e112-44db-9d15-77579655d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:05.611421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 645/1272] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:37:05.640273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f801b-b3a1-4009-a535-d7d6e6540152 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:05.640610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f801b-b3a1-4009-a535-d7d6e6540152 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:05.640867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f801b-b3a1-4009-a535-d7d6e6540152 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:05.642881 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 628/1273] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:05.649146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f01a8-d860-46c6-9a1d-a812cb4dc5f9 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:05.649437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f01a8-d860-46c6-9a1d-a812cb4dc5f9 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:05.649718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f01a8-d860-46c6-9a1d-a812cb4dc5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:05.660405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f801b-b3a1-4009-a535-d7d6e6540152 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:05.668567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-6f2f01a8-d860-46c6-9a1d-a812cb4dc5f9 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:05.669792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6f2f01a8-d860-46c6-9a1d-a812cb4dc5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:05.676013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f801b-b3a1-4009-a535-d7d6e6540152 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:05.683556 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f66c6-15af-40c9-b9e9-dc9c32624f12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:05.684218 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f66c6-15af-40c9-b9e9-dc9c32624f12 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:05.684498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 646/1274] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:05.684622 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f66c6-15af-40c9-b9e9-dc9c32624f12 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:05.684809 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f66c6-15af-40c9-b9e9-dc9c32624f12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:05.698650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f66c6-15af-40c9-b9e9-dc9c32624f12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:05.700387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f66c6-15af-40c9-b9e9-dc9c32624f12 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:05.711847 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 629/1275] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:37:05.738912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701d2c0-8065-4ca7-a1d1-7fb3289ba6b9 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:05.739888 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701d2c0-8065-4ca7-a1d1-7fb3289ba6b9 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:05.747812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701d2c0-8065-4ca7-a1d1-7fb3289ba6b9 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:05.747812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 647/1276] 10.222.0.25 () {54 vars in 966 bytes} [Fri Aug 27 04:37:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:05.749040 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a641fa2-5b82-41e7-8468-3b5b7ff99ede None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:05.749335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a641fa2-5b82-41e7-8468-3b5b7ff99ede None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:05.749618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a641fa2-5b82-41e7-8468-3b5b7ff99ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:05.809724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0a641fa2-5b82-41e7-8468-3b5b7ff99ede None None] MFA Rules not processed for user `c711b68b32a7435a93b12553972f9f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:05.809724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0a641fa2-5b82-41e7-8468-3b5b7ff99ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:05.912066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 630/1277] 10.222.0.25 () {58 vars in 1064 bytes} [Fri Aug 27 04:37:05 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:05.921866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701d2c0-8065-4ca7-a1d1-7fb3289ba6b9 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:05.935283 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701d2c0-8065-4ca7-a1d1-7fb3289ba6b9 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:05.939325 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303e11d-6dad-4cae-963d-b957d9c5ef8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:05.940014 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303e11d-6dad-4cae-963d-b957d9c5ef8f service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:05.940301 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303e11d-6dad-4cae-963d-b957d9c5ef8f service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:05.940639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303e11d-6dad-4cae-963d-b957d9c5ef8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:05.951379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303e11d-6dad-4cae-963d-b957d9c5ef8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:05.953219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303e11d-6dad-4cae-963d-b957d9c5ef8f service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:05.966678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 648/1278] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:08.081805 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c12d-9e0a-46f7-8460-adfa2c3ec9ba None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:08.082231 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c12d-9e0a-46f7-8460-adfa2c3ec9ba None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:08.082406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c12d-9e0a-46f7-8460-adfa2c3ec9ba None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:08.085418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 631/1279] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:08.092200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ef72f-9c26-4784-9d14-140d8bdedc5f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:08.092759 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ef72f-9c26-4784-9d14-140d8bdedc5f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:08.092869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ef72f-9c26-4784-9d14-140d8bdedc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:08.118255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-121ef72f-9c26-4784-9d14-140d8bdedc5f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:08.118255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-121ef72f-9c26-4784-9d14-140d8bdedc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:08.126064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 649/1280] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:08.177886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c12d-9e0a-46f7-8460-adfa2c3ec9ba None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:08.193135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c12d-9e0a-46f7-8460-adfa2c3ec9ba None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:08.203089 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289d0ee-7b48-4abc-a561-8533b2840a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:08.204149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289d0ee-7b48-4abc-a561-8533b2840a85 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:08.204696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289d0ee-7b48-4abc-a561-8533b2840a85 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:08.205196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289d0ee-7b48-4abc-a561-8533b2840a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:08.220081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289d0ee-7b48-4abc-a561-8533b2840a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:08.222062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289d0ee-7b48-4abc-a561-8533b2840a85 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:08.233584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 632/1281] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:37:10.597125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12622f74-43db-46fb-af96-380098c0dbcf None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:10.597671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12622f74-43db-46fb-af96-380098c0dbcf None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:10.597671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12622f74-43db-46fb-af96-380098c0dbcf None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:10.599482 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 650/1282] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:10.606007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb587-cc79-4bef-a95a-840f654b99dc None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:10.606751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb587-cc79-4bef-a95a-840f654b99dc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:10.606751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb587-cc79-4bef-a95a-840f654b99dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:10.625764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-eaefb587-cc79-4bef-a95a-840f654b99dc None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:10.626953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-eaefb587-cc79-4bef-a95a-840f654b99dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:10.635886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 633/1283] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:10.683755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12622f74-43db-46fb-af96-380098c0dbcf None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:10.699660 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12622f74-43db-46fb-af96-380098c0dbcf None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:10.705917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24cb11-cf02-4ee2-b406-f1deb2c3bd3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:10.706554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24cb11-cf02-4ee2-b406-f1deb2c3bd3e service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:10.706832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24cb11-cf02-4ee2-b406-f1deb2c3bd3e service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:10.707263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24cb11-cf02-4ee2-b406-f1deb2c3bd3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:10.715792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24cb11-cf02-4ee2-b406-f1deb2c3bd3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:10.717389 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24cb11-cf02-4ee2-b406-f1deb2c3bd3e service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:10.727955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 651/1284] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:13.156652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adff748-9d6d-4d90-8f7a-a14e96f5e507 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:13.157114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adff748-9d6d-4d90-8f7a-a14e96f5e507 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:13.157207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adff748-9d6d-4d90-8f7a-a14e96f5e507 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:13.159192 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 634/1285] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:13.165830 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31367ea-6ee9-470e-966c-0b6886420ff0 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:13.166339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31367ea-6ee9-470e-966c-0b6886420ff0 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:13.166483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31367ea-6ee9-470e-966c-0b6886420ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:13.186107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a31367ea-6ee9-470e-966c-0b6886420ff0 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:13.187389 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a31367ea-6ee9-470e-966c-0b6886420ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:13.196225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 652/1286] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:13.241187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adff748-9d6d-4d90-8f7a-a14e96f5e507 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:13.256029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adff748-9d6d-4d90-8f7a-a14e96f5e507 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:13.261472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75150c31-2ea9-431a-bffd-72f4c63388f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:13.262109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75150c31-2ea9-431a-bffd-72f4c63388f5 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:13.262387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75150c31-2ea9-431a-bffd-72f4c63388f5 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:13.262655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75150c31-2ea9-431a-bffd-72f4c63388f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:13.271811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75150c31-2ea9-431a-bffd-72f4c63388f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:13.273414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75150c31-2ea9-431a-bffd-72f4c63388f5 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:13.284397 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 635/1287] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:15.677358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253203c-1877-447f-a111-91b9b48a9e7f None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:15.677938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253203c-1877-447f-a111-91b9b48a9e7f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:15.677938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253203c-1877-447f-a111-91b9b48a9e7f None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:15.679673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 653/1288] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:37:15.688650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e6d5-1f0d-4eb6-a5c6-849ceedc7967 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:15.689292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e6d5-1f0d-4eb6-a5c6-849ceedc7967 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:15.689830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e6d5-1f0d-4eb6-a5c6-849ceedc7967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:15.731557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3803e6d5-1f0d-4eb6-a5c6-849ceedc7967 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:15.734505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3803e6d5-1f0d-4eb6-a5c6-849ceedc7967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:15.755635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 636/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:15.818219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253203c-1877-447f-a111-91b9b48a9e7f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:15.843848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253203c-1877-447f-a111-91b9b48a9e7f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:15.853938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1226314-234c-4db2-9086-285b71fbb9be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:15.854944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1226314-234c-4db2-9086-285b71fbb9be service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:15.855421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1226314-234c-4db2-9086-285b71fbb9be service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:15.855908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1226314-234c-4db2-9086-285b71fbb9be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:15.870887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1226314-234c-4db2-9086-285b71fbb9be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:15.873783 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1226314-234c-4db2-9086-285b71fbb9be service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:15.892389 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 654/1290] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:37:18.359274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc22f45-b4c2-4442-ac33-2d943ad3b1d2 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:18.359841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc22f45-b4c2-4442-ac33-2d943ad3b1d2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:18.359955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc22f45-b4c2-4442-ac33-2d943ad3b1d2 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:18.362507 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 637/1291] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:18.371782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c26295-b1c7-4b48-945f-4c1da796b7c9 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:18.372624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c26295-b1c7-4b48-945f-4c1da796b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:18.372782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c26295-b1c7-4b48-945f-4c1da796b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:18.393354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-27c26295-b1c7-4b48-945f-4c1da796b7c9 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:18.394600 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-27c26295-b1c7-4b48-945f-4c1da796b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:18.403905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 655/1292] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:37:18.461300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc22f45-b4c2-4442-ac33-2d943ad3b1d2 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:18.481018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc22f45-b4c2-4442-ac33-2d943ad3b1d2 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:18.487039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33722f-1951-4430-ba35-4d6a12c1f46c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:18.487694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33722f-1951-4430-ba35-4d6a12c1f46c service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:18.487973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33722f-1951-4430-ba35-4d6a12c1f46c service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:18.488250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33722f-1951-4430-ba35-4d6a12c1f46c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:18.498104 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33722f-1951-4430-ba35-4d6a12c1f46c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:18.499746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33722f-1951-4430-ba35-4d6a12c1f46c service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:18.511016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 638/1293] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:21.151337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7619af-4898-4955-b832-95f1fd9ccd4d None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:21.151337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7619af-4898-4955-b832-95f1fd9ccd4d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:21.151337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7619af-4898-4955-b832-95f1fd9ccd4d None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:21.156450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 656/1294] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:21.160034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c340d-b08b-439a-bbbb-8b8fc5c5c434 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:21.160034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c340d-b08b-439a-bbbb-8b8fc5c5c434 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:21.160034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c340d-b08b-439a-bbbb-8b8fc5c5c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:21.179102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-f14c340d-b08b-439a-bbbb-8b8fc5c5c434 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:21.180318 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f14c340d-b08b-439a-bbbb-8b8fc5c5c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:21.195359 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 639/1295] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:21.245779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7619af-4898-4955-b832-95f1fd9ccd4d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:21.262505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7619af-4898-4955-b832-95f1fd9ccd4d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:21.274844 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a76af-0847-4f7f-990c-4aa5fec6bd89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:21.275512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a76af-0847-4f7f-990c-4aa5fec6bd89 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:21.275799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a76af-0847-4f7f-990c-4aa5fec6bd89 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:21.276076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a76af-0847-4f7f-990c-4aa5fec6bd89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:21.285105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a76af-0847-4f7f-990c-4aa5fec6bd89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:21.287198 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a76af-0847-4f7f-990c-4aa5fec6bd89 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:21.298214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 657/1296] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:22.043562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b494-a848-4606-9423-0a0931854bf0 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:22.043768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b494-a848-4606-9423-0a0931854bf0 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:22.044037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b494-a848-4606-9423-0a0931854bf0 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:22.045969 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 640/1297] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:22.052601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b192e-0865-4d14-970d-41030e41c4ea None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:22.052969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b192e-0865-4d14-970d-41030e41c4ea None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:22.053322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b192e-0865-4d14-970d-41030e41c4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:22.072457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e03b192e-0865-4d14-970d-41030e41c4ea None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:22.073659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e03b192e-0865-4d14-970d-41030e41c4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:22.081532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 658/1298] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:22.140819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637855f-3658-447c-aa07-3a2f8300300e None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:22.141207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637855f-3658-447c-aa07-3a2f8300300e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:22.141548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637855f-3658-447c-aa07-3a2f8300300e None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:22.143564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 641/1299] 10.222.0.25 () {54 vars in 966 bytes} [Fri Aug 27 04:37:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:22.150132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36f1d-5185-4cd7-b4b2-e35b5d5354cb None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:22.150445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36f1d-5185-4cd7-b4b2-e35b5d5354cb None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:22.150723 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36f1d-5185-4cd7-b4b2-e35b5d5354cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:22.201776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-0aa36f1d-5185-4cd7-b4b2-e35b5d5354cb None None] MFA Rules not processed for user `9f041d8d6b5949c48920b729511f3783`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:22.203024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0aa36f1d-5185-4cd7-b4b2-e35b5d5354cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:22.264968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 659/1300] 10.222.0.25 () {58 vars in 1064 bytes} [Fri Aug 27 04:37:22 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:22.273269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637855f-3658-447c-aa07-3a2f8300300e None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:22.284757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637855f-3658-447c-aa07-3a2f8300300e None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:22.289287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e0e18-6db3-40fd-970e-61c895cf601b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f041d8d6b5949c48920b729511f3783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:22.289997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0e18-6db3-40fd-970e-61c895cf601b service glance] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:22.290324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0e18-6db3-40fd-970e-61c895cf601b service glance] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:22.290643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0e18-6db3-40fd-970e-61c895cf601b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:22.302001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e0e18-6db3-40fd-970e-61c895cf601b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:22.303410 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e0e18-6db3-40fd-970e-61c895cf601b service glance] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:22.313937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 642/1301] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:22.990635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc30c84-ea4d-465f-865a-4448eb3223fa None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:22.990949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc30c84-ea4d-465f-865a-4448eb3223fa None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:22.991233 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc30c84-ea4d-465f-865a-4448eb3223fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:23.052249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ccc30c84-ea4d-465f-865a-4448eb3223fa None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:23.053514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ccc30c84-ea4d-465f-865a-4448eb3223fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:23.127229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 660/1302] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:37:22 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:23.174290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a6b00-0a21-4d3c-a6fd-a19969ff37cd None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:23.174580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a6b00-0a21-4d3c-a6fd-a19969ff37cd None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:23.174859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a6b00-0a21-4d3c-a6fd-a19969ff37cd None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:23.177596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 643/1303] 10.222.0.25 () {54 vars in 942 bytes} [Fri Aug 27 04:37:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:23.185479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d638f2-bd92-49b8-8dca-8fea3ef027ee None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:23.185773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d638f2-bd92-49b8-8dca-8fea3ef027ee None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:23.186053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d638f2-bd92-49b8-8dca-8fea3ef027ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:23.239374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-48d638f2-bd92-49b8-8dca-8fea3ef027ee None None] MFA Rules not processed for user `c23aad5d62b84cd7a4da788500148f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:23.239374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-48d638f2-bd92-49b8-8dca-8fea3ef027ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:23.316195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 661/1304] 10.222.0.25 () {58 vars in 1040 bytes} [Fri Aug 27 04:37:23 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:23.326919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a6b00-0a21-4d3c-a6fd-a19969ff37cd None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:23.341495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a6b00-0a21-4d3c-a6fd-a19969ff37cd None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:23.346777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710406a-81bc-4313-8fc2-1414aa63d49a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:23.347470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710406a-81bc-4313-8fc2-1414aa63d49a service swift] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:23.347754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710406a-81bc-4313-8fc2-1414aa63d49a service swift] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:23.348038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710406a-81bc-4313-8fc2-1414aa63d49a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:23.357666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710406a-81bc-4313-8fc2-1414aa63d49a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:23.359665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710406a-81bc-4313-8fc2-1414aa63d49a service swift] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:23.370890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 644/1305] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:37:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:37:23.742549 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470cf4c-abeb-4366-9833-8fb1d4919d30 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:23.742872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470cf4c-abeb-4366-9833-8fb1d4919d30 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:23.743123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470cf4c-abeb-4366-9833-8fb1d4919d30 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:23.744961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 662/1306] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:23.751123 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277925e-8543-4771-90e5-d28e8584d168 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:23.751444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277925e-8543-4771-90e5-d28e8584d168 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:23.751754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277925e-8543-4771-90e5-d28e8584d168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:23.772652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3277925e-8543-4771-90e5-d28e8584d168 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:23.774612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3277925e-8543-4771-90e5-d28e8584d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:23.782850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 645/1307] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:23.830643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470cf4c-abeb-4366-9833-8fb1d4919d30 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:23.847757 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470cf4c-abeb-4366-9833-8fb1d4919d30 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:23.855754 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59489162-fda4-454a-8bc5-f8a290ea082e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:23.856453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489162-fda4-454a-8bc5-f8a290ea082e service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:23.856744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489162-fda4-454a-8bc5-f8a290ea082e service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:23.857025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489162-fda4-454a-8bc5-f8a290ea082e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:23.867395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59489162-fda4-454a-8bc5-f8a290ea082e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:23.869215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59489162-fda4-454a-8bc5-f8a290ea082e service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:23.881796 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 663/1308] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:26.337926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ba73-5f72-45a3-a0e5-655cad706180 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:26.338476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ba73-5f72-45a3-a0e5-655cad706180 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:26.338476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ba73-5f72-45a3-a0e5-655cad706180 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:26.340589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 646/1309] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:26.346897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fb719-a568-455a-b411-2cac2d9da191 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:26.347370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fb719-a568-455a-b411-2cac2d9da191 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:26.347501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fb719-a568-455a-b411-2cac2d9da191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:26.367511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a62fb719-a568-455a-b411-2cac2d9da191 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:26.369231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a62fb719-a568-455a-b411-2cac2d9da191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:26.381695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 664/1310] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:26.460265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361ba73-5f72-45a3-a0e5-655cad706180 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:26.487864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361ba73-5f72-45a3-a0e5-655cad706180 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:26.497896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d42c92-9099-4d4a-9a4f-d9b666702f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:26.499178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d42c92-9099-4d4a-9a4f-d9b666702f4d service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:26.499832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d42c92-9099-4d4a-9a4f-d9b666702f4d service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:26.500671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d42c92-9099-4d4a-9a4f-d9b666702f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:26.519496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d42c92-9099-4d4a-9a4f-d9b666702f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:26.524495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d42c92-9099-4d4a-9a4f-d9b666702f4d service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:26.543832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 647/1311] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:37:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:41.841355 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9667b-22be-4b47-9050-b834d6ed3196 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:41.841884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9667b-22be-4b47-9050-b834d6ed3196 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:41.841884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9667b-22be-4b47-9050-b834d6ed3196 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:41.843724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 665/1312] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:41.849651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e384-96f2-40ee-b392-ab118c0e77f3 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:41.850079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e384-96f2-40ee-b392-ab118c0e77f3 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:41.850208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e384-96f2-40ee-b392-ab118c0e77f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:41.868323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7c77e384-96f2-40ee-b392-ab118c0e77f3 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:41.869573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7c77e384-96f2-40ee-b392-ab118c0e77f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:41.877388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 648/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:41.902392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9667b-22be-4b47-9050-b834d6ed3196 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:41.914799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9667b-22be-4b47-9050-b834d6ed3196 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:41.919214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f306e8-6f72-4472-b5bd-44a857e4d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:41.919848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f306e8-6f72-4472-b5bd-44a857e4d483 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:41.920125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f306e8-6f72-4472-b5bd-44a857e4d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:41.920426 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f306e8-6f72-4472-b5bd-44a857e4d483 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:41.921147 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f306e8-6f72-4472-b5bd-44a857e4d483 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:41.922973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f306e8-6f72-4472-b5bd-44a857e4d483 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:41.942350 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 666/1314] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:37:41 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:37:44.048712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065587f2-b02b-4124-9333-38527639f992 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:44.049253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065587f2-b02b-4124-9333-38527639f992 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:44.049253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065587f2-b02b-4124-9333-38527639f992 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:44.051601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 649/1315] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:44.057775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afeeb0-8b65-4376-a632-1ac98dc4c01e None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:44.058187 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afeeb0-8b65-4376-a632-1ac98dc4c01e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:44.058344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afeeb0-8b65-4376-a632-1ac98dc4c01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:44.075988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d0afeeb0-8b65-4376-a632-1ac98dc4c01e None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:44.077257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d0afeeb0-8b65-4376-a632-1ac98dc4c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:44.085635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 667/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:44.109753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065587f2-b02b-4124-9333-38527639f992 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:44.122018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065587f2-b02b-4124-9333-38527639f992 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:44.127849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944842-c1bf-47d8-9228-5bb0712bbb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:44.127849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944842-c1bf-47d8-9228-5bb0712bbb7d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:44.127849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944842-c1bf-47d8-9228-5bb0712bbb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:44.127849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944842-c1bf-47d8-9228-5bb0712bbb7d admin admin] PATH_INFO: `/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:44.138267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce944842-c1bf-47d8-9228-5bb0712bbb7d admin admin] RBAC: Authorizing `identity:get_project(project_id=26a76e9656c64e7ea5e88bdd2440c8d8)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:44.140494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce944842-c1bf-47d8-9228-5bb0712bbb7d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:44.142095 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 650/1317] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:37:44 2021] GET /identity/v3/projects/26a76e9656c64e7ea5e88bdd2440c8d8 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:44.149494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afeeb0-8b65-4376-a632-1ac98dc4c01e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:44.158589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afeeb0-8b65-4376-a632-1ac98dc4c01e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:44.163686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac10df-7e15-4199-96a2-21847535ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:44.164385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac10df-7e15-4199-96a2-21847535ec06 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:44.164731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac10df-7e15-4199-96a2-21847535ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:44.165004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac10df-7e15-4199-96a2-21847535ec06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:44.165826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac10df-7e15-4199-96a2-21847535ec06 admin admin] RBAC: Adding query filter params (scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:37:44.166131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac10df-7e15-4199-96a2-21847535ec06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:44.167940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac10df-7e15-4199-96a2-21847535ec06 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:44.176525 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 668/1318] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 04:37:44 2021] GET /identity/v3/role_assignments?scope.project.id=26a76e9656c64e7ea5e88bdd2440c8d8 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:37:44.182785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944842-c1bf-47d8-9228-5bb0712bbb7d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:44.193006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944842-c1bf-47d8-9228-5bb0712bbb7d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:44.197967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b08756-565a-4324-9751-de0a3a314a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:44.198798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08756-565a-4324-9751-de0a3a314a90 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:44.199075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08756-565a-4324-9751-de0a3a314a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:44.199341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08756-565a-4324-9751-de0a3a314a90 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:44.200526 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b08756-565a-4324-9751-de0a3a314a90 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:44.202304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b08756-565a-4324-9751-de0a3a314a90 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:44.203848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 651/1319] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:37:44 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:44.210088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac10df-7e15-4199-96a2-21847535ec06 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:44.219552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac10df-7e15-4199-96a2-21847535ec06 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:44.224122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd1e91-97e6-4d53-b271-76bb51162ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:44.225000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd1e91-97e6-4d53-b271-76bb51162ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:44.225285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd1e91-97e6-4d53-b271-76bb51162ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:44.225564 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd1e91-97e6-4d53-b271-76bb51162ce4 admin admin] PATH_INFO: `/v3/users/4172444346f24a05896f00771c673d03` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:44.239108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd1e91-97e6-4d53-b271-76bb51162ce4 admin admin] RBAC: Authorizing `identity:get_user(user_id=4172444346f24a05896f00771c673d03)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:44.241284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd1e91-97e6-4d53-b271-76bb51162ce4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:44.242918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 669/1320] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:37:44 2021] GET /identity/v3/users/4172444346f24a05896f00771c673d03 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:46.452701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc3827-ecbc-492d-a141-c901a40a8682 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:46.453301 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc3827-ecbc-492d-a141-c901a40a8682 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:46.453301 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc3827-ecbc-492d-a141-c901a40a8682 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:46.455017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 652/1321] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:46.460936 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff88f0b-c30e-4a58-9df6-39d5a26cb9d9 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:46.461337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff88f0b-c30e-4a58-9df6-39d5a26cb9d9 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:46.461568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff88f0b-c30e-4a58-9df6-39d5a26cb9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:46.478946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-8ff88f0b-c30e-4a58-9df6-39d5a26cb9d9 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:46.480136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8ff88f0b-c30e-4a58-9df6-39d5a26cb9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:46.487833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 670/1322] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:46.512569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc3827-ecbc-492d-a141-c901a40a8682 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:46.525125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc3827-ecbc-492d-a141-c901a40a8682 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:46.529611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b692a6-f2ca-4497-aa4f-d6499bd6087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:46.530556 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b692a6-f2ca-4497-aa4f-d6499bd6087d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:46.530835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b692a6-f2ca-4497-aa4f-d6499bd6087d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:46.531108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b692a6-f2ca-4497-aa4f-d6499bd6087d admin admin] PATH_INFO: `/v3/projects/284a746657ea43e294ce0896f49bd3a6` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:46.541817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b692a6-f2ca-4497-aa4f-d6499bd6087d admin admin] RBAC: Authorizing `identity:get_project(project_id=284a746657ea43e294ce0896f49bd3a6)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:46.543881 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b692a6-f2ca-4497-aa4f-d6499bd6087d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:46.545595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 653/1323] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:37:46 2021] GET /identity/v3/projects/284a746657ea43e294ce0896f49bd3a6 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:46.552872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff88f0b-c30e-4a58-9df6-39d5a26cb9d9 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:46.562028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff88f0b-c30e-4a58-9df6-39d5a26cb9d9 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:46.567173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113488e-01f4-48c7-b1aa-36b0402da567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:46.567871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113488e-01f4-48c7-b1aa-36b0402da567 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:46.568084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113488e-01f4-48c7-b1aa-36b0402da567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:46.568367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113488e-01f4-48c7-b1aa-36b0402da567 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:46.569132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113488e-01f4-48c7-b1aa-36b0402da567 admin admin] RBAC: Adding query filter params (scope.project.id=284a746657ea43e294ce0896f49bd3a6) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:37:46.569430 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113488e-01f4-48c7-b1aa-36b0402da567 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:46.571454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113488e-01f4-48c7-b1aa-36b0402da567 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:46.576897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 671/1324] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 04:37:46 2021] GET /identity/v3/role_assignments?scope.project.id=284a746657ea43e294ce0896f49bd3a6 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:46.583291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b692a6-f2ca-4497-aa4f-d6499bd6087d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:46.592975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b692a6-f2ca-4497-aa4f-d6499bd6087d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:46.597524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba676a5-bc18-4991-945d-5780daa0bc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:46.598369 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba676a5-bc18-4991-945d-5780daa0bc43 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:46.598669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba676a5-bc18-4991-945d-5780daa0bc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:46.598944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba676a5-bc18-4991-945d-5780daa0bc43 admin admin] PATH_INFO: `/v3/users/5805367ebb924e8a9239816068e327b2` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:46.612208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba676a5-bc18-4991-945d-5780daa0bc43 admin admin] RBAC: Authorizing `identity:get_user(user_id=5805367ebb924e8a9239816068e327b2)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:46.614923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba676a5-bc18-4991-945d-5780daa0bc43 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:46.616609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 654/1325] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:37:46 2021] GET /identity/v3/users/5805367ebb924e8a9239816068e327b2 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:48.807456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c932d-d2b2-4e91-9dd1-f16abebc19c2 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:48.808121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c932d-d2b2-4e91-9dd1-f16abebc19c2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:48.808121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c932d-d2b2-4e91-9dd1-f16abebc19c2 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:48.809876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 672/1326] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:48.815787 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e8644-d875-480c-94aa-ae29512ca828 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:48.816202 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e8644-d875-480c-94aa-ae29512ca828 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:48.816413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e8644-d875-480c-94aa-ae29512ca828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:48.833725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0c7e8644-d875-480c-94aa-ae29512ca828 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:48.834909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0c7e8644-d875-480c-94aa-ae29512ca828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:48.842518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 655/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:48.866826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c932d-d2b2-4e91-9dd1-f16abebc19c2 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:48.879025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c932d-d2b2-4e91-9dd1-f16abebc19c2 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:48.883529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d3ae-b8a7-4f21-bbfc-9b825d06beef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:48.884391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d3ae-b8a7-4f21-bbfc-9b825d06beef admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:48.884679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d3ae-b8a7-4f21-bbfc-9b825d06beef admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:48.884956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d3ae-b8a7-4f21-bbfc-9b825d06beef admin admin] PATH_INFO: `/v3/projects/28c22cecb66d4652809a04ec1798ad5b` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:48.886126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5d3ae-b8a7-4f21-bbfc-9b825d06beef admin admin] RBAC: Authorizing `identity:get_project(project_id=28c22cecb66d4652809a04ec1798ad5b)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:48.887901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5d3ae-b8a7-4f21-bbfc-9b825d06beef admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:48.889601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 673/1328] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:37:48 2021] GET /identity/v3/projects/28c22cecb66d4652809a04ec1798ad5b => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:48.896866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e8644-d875-480c-94aa-ae29512ca828 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:48.905947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e8644-d875-480c-94aa-ae29512ca828 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:48.911272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cb2b2-1b1d-4451-97e7-233083360462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:48.911896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cb2b2-1b1d-4451-97e7-233083360462 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:48.912171 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cb2b2-1b1d-4451-97e7-233083360462 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:48.912476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cb2b2-1b1d-4451-97e7-233083360462 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:48.913272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cb2b2-1b1d-4451-97e7-233083360462 admin admin] RBAC: Adding query filter params (scope.project.id=28c22cecb66d4652809a04ec1798ad5b) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:37:48.913566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cb2b2-1b1d-4451-97e7-233083360462 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:48.915409 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cb2b2-1b1d-4451-97e7-233083360462 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:48.922211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 656/1329] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 04:37:48 2021] GET /identity/v3/role_assignments?scope.project.id=28c22cecb66d4652809a04ec1798ad5b => generated 879 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:48.928469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d3ae-b8a7-4f21-bbfc-9b825d06beef admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:48.938000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d3ae-b8a7-4f21-bbfc-9b825d06beef admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:48.943055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e426-db63-47a9-87de-c7fb7aa09347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:48.943904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e426-db63-47a9-87de-c7fb7aa09347 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:48.944190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e426-db63-47a9-87de-c7fb7aa09347 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:48.944509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e426-db63-47a9-87de-c7fb7aa09347 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:48.945738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451e426-db63-47a9-87de-c7fb7aa09347 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:48.947461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451e426-db63-47a9-87de-c7fb7aa09347 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:48.949065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 674/1330] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:37:48 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:51.136107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb68f2-aa43-495d-a0ef-c6254d5336fe None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:51.136650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb68f2-aa43-495d-a0ef-c6254d5336fe None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:51.136767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb68f2-aa43-495d-a0ef-c6254d5336fe None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:51.138500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 657/1331] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:51.144412 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06f48-c768-4d86-89dd-96e213cace4e None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:51.144838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06f48-c768-4d86-89dd-96e213cace4e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:51.144964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06f48-c768-4d86-89dd-96e213cace4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:51.162474 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-13c06f48-c768-4d86-89dd-96e213cace4e None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:51.163782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-13c06f48-c768-4d86-89dd-96e213cace4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:51.171719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 675/1332] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:51.196938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb68f2-aa43-495d-a0ef-c6254d5336fe None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:51.209365 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb68f2-aa43-495d-a0ef-c6254d5336fe None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:51.213822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56171f-e078-4868-921a-b42221f344f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:51.214658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56171f-e078-4868-921a-b42221f344f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:51.214938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56171f-e078-4868-921a-b42221f344f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:51.215216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56171f-e078-4868-921a-b42221f344f6 admin admin] PATH_INFO: `/v3/projects/433caccd464c42a085d7cc59c146af8c` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:51.226561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56171f-e078-4868-921a-b42221f344f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=433caccd464c42a085d7cc59c146af8c)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:51.228708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56171f-e078-4868-921a-b42221f344f6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:51.230375 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 658/1333] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:37:51 2021] GET /identity/v3/projects/433caccd464c42a085d7cc59c146af8c => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:51.236927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c06f48-c768-4d86-89dd-96e213cace4e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:51.246542 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c06f48-c768-4d86-89dd-96e213cace4e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:51.251077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b1800-760d-42ff-aba4-31641e646a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:51.251716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b1800-760d-42ff-aba4-31641e646a90 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:51.251998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b1800-760d-42ff-aba4-31641e646a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:51.252273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b1800-760d-42ff-aba4-31641e646a90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:51.253063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b1800-760d-42ff-aba4-31641e646a90 admin admin] RBAC: Adding query filter params (scope.project.id=433caccd464c42a085d7cc59c146af8c) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:37:51.253371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b1800-760d-42ff-aba4-31641e646a90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:51.255218 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b1800-760d-42ff-aba4-31641e646a90 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:51.260856 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 676/1334] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 04:37:51 2021] GET /identity/v3/role_assignments?scope.project.id=433caccd464c42a085d7cc59c146af8c => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:51.266959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56171f-e078-4868-921a-b42221f344f6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:51.277005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56171f-e078-4868-921a-b42221f344f6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:51.281529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ec975-2639-46d4-b652-c40df0b194ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:51.282363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ec975-2639-46d4-b652-c40df0b194ac admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:51.282648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ec975-2639-46d4-b652-c40df0b194ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:51.282928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ec975-2639-46d4-b652-c40df0b194ac admin admin] PATH_INFO: `/v3/users/acba502da4224b0d9c4c6f21274a3f28` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:51.296491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ec975-2639-46d4-b652-c40df0b194ac admin admin] RBAC: Authorizing `identity:get_user(user_id=acba502da4224b0d9c4c6f21274a3f28)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:51.298630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ec975-2639-46d4-b652-c40df0b194ac admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:51.300239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 659/1335] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:37:51 2021] GET /identity/v3/users/acba502da4224b0d9c4c6f21274a3f28 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:51.306928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b1800-760d-42ff-aba4-31641e646a90 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:51.316730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b1800-760d-42ff-aba4-31641e646a90 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:51.321279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53322830-5a1b-41e2-812c-8275d57e59a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:51.322127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53322830-5a1b-41e2-812c-8275d57e59a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:51.322411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53322830-5a1b-41e2-812c-8275d57e59a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:51.322685 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53322830-5a1b-41e2-812c-8275d57e59a8 admin admin] PATH_INFO: `/v3/users/bc4f127a48234d9591294293a6ee068a` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:51.335725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53322830-5a1b-41e2-812c-8275d57e59a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=bc4f127a48234d9591294293a6ee068a)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:51.337904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53322830-5a1b-41e2-812c-8275d57e59a8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:51.339524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 677/1336] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:37:51 2021] GET /identity/v3/users/bc4f127a48234d9591294293a6ee068a => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:53.546932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101e4cb-671a-4013-83f3-4f5853f1f0cf None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:53.547517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101e4cb-671a-4013-83f3-4f5853f1f0cf None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:53.547517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101e4cb-671a-4013-83f3-4f5853f1f0cf None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:53.549313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 660/1337] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:53.555101 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7bb8-814c-4184-9735-609cb3d9d518 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:53.555525 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7bb8-814c-4184-9735-609cb3d9d518 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:53.555719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7bb8-814c-4184-9735-609cb3d9d518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:53.574999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-0f2a7bb8-814c-4184-9735-609cb3d9d518 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:53.576216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0f2a7bb8-814c-4184-9735-609cb3d9d518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:53.584807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 678/1338] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:53.609511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101e4cb-671a-4013-83f3-4f5853f1f0cf None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:53.621751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101e4cb-671a-4013-83f3-4f5853f1f0cf None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:53.626261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde03ee-7300-4646-a488-b31242e2c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:53.627144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde03ee-7300-4646-a488-b31242e2c480 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:53.627448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde03ee-7300-4646-a488-b31242e2c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:53.627720 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde03ee-7300-4646-a488-b31242e2c480 admin admin] PATH_INFO: `/v3/projects/8da75063c9dd4ebc8f3202442be89fdc` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:53.638738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde03ee-7300-4646-a488-b31242e2c480 admin admin] RBAC: Authorizing `identity:get_project(project_id=8da75063c9dd4ebc8f3202442be89fdc)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:53.640854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde03ee-7300-4646-a488-b31242e2c480 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:53.642583 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 661/1339] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:37:53 2021] GET /identity/v3/projects/8da75063c9dd4ebc8f3202442be89fdc => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:53.650271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7bb8-814c-4184-9735-609cb3d9d518 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:53.659264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7bb8-814c-4184-9735-609cb3d9d518 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:53.663945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd405f-9e17-4e98-821c-d5ebf9e4d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:53.664618 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd405f-9e17-4e98-821c-d5ebf9e4d85e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:53.664900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd405f-9e17-4e98-821c-d5ebf9e4d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:53.665173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd405f-9e17-4e98-821c-d5ebf9e4d85e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:53.665934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd405f-9e17-4e98-821c-d5ebf9e4d85e admin admin] RBAC: Adding query filter params (scope.project.id=8da75063c9dd4ebc8f3202442be89fdc) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:37:53.666236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd405f-9e17-4e98-821c-d5ebf9e4d85e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:53.668086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd405f-9e17-4e98-821c-d5ebf9e4d85e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:53.673476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 679/1340] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 04:37:53 2021] GET /identity/v3/role_assignments?scope.project.id=8da75063c9dd4ebc8f3202442be89fdc => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:53.679807 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde03ee-7300-4646-a488-b31242e2c480 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:53.689672 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde03ee-7300-4646-a488-b31242e2c480 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:53.694947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a20be-c16d-4d56-82fe-aca86a9b2996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:53.695818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a20be-c16d-4d56-82fe-aca86a9b2996 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:53.696102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a20be-c16d-4d56-82fe-aca86a9b2996 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:53.696425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a20be-c16d-4d56-82fe-aca86a9b2996 admin admin] PATH_INFO: `/v3/users/0d41935c2834449c838a7a569161c5f2` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:53.710689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a20be-c16d-4d56-82fe-aca86a9b2996 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d41935c2834449c838a7a569161c5f2)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:53.712876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a20be-c16d-4d56-82fe-aca86a9b2996 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:53.714535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 662/1341] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:37:53 2021] GET /identity/v3/users/0d41935c2834449c838a7a569161c5f2 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:37:55.921346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c7be-05c8-4923-8840-a984eeac504e None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:55.921868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c7be-05c8-4923-8840-a984eeac504e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:55.921956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c7be-05c8-4923-8840-a984eeac504e None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:55.923712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 680/1342] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:55.930740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d06e97-ff74-439f-84b3-165ac482d1a6 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:55.931220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d06e97-ff74-439f-84b3-165ac482d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:55.931329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d06e97-ff74-439f-84b3-165ac482d1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:55.948601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-40d06e97-ff74-439f-84b3-165ac482d1a6 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:55.949722 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-40d06e97-ff74-439f-84b3-165ac482d1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:55.957456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 663/1343] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:55.981836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c7be-05c8-4923-8840-a984eeac504e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:55.994641 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c7be-05c8-4923-8840-a984eeac504e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:55.999164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfd34-5f8d-494a-9328-a95042aadbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:56.000006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfd34-5f8d-494a-9328-a95042aadbbd admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:56.000281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfd34-5f8d-494a-9328-a95042aadbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:56.000593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfd34-5f8d-494a-9328-a95042aadbbd admin admin] PATH_INFO: `/v3/projects/9b9245eaa111477eacd21e257b36b348` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:56.010993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfd34-5f8d-494a-9328-a95042aadbbd admin admin] RBAC: Authorizing `identity:get_project(project_id=9b9245eaa111477eacd21e257b36b348)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:56.013082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfd34-5f8d-494a-9328-a95042aadbbd admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:56.014763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 681/1344] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:37:55 2021] GET /identity/v3/projects/9b9245eaa111477eacd21e257b36b348 => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:56.021460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d06e97-ff74-439f-84b3-165ac482d1a6 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:56.030581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d06e97-ff74-439f-84b3-165ac482d1a6 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:56.035597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be80c6f-a068-4be9-89df-e98ab77ee56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:56.036230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be80c6f-a068-4be9-89df-e98ab77ee56f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:56.036545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be80c6f-a068-4be9-89df-e98ab77ee56f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:56.036820 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be80c6f-a068-4be9-89df-e98ab77ee56f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:56.037576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be80c6f-a068-4be9-89df-e98ab77ee56f admin admin] RBAC: Adding query filter params (scope.project.id=9b9245eaa111477eacd21e257b36b348) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:37:56.037880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be80c6f-a068-4be9-89df-e98ab77ee56f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:56.039733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be80c6f-a068-4be9-89df-e98ab77ee56f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:56.045063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 664/1345] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 04:37:56 2021] GET /identity/v3/role_assignments?scope.project.id=9b9245eaa111477eacd21e257b36b348 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:37:56.051808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfd34-5f8d-494a-9328-a95042aadbbd admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:56.061572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfd34-5f8d-494a-9328-a95042aadbbd admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:56.066294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fdc0e5-a641-464d-9122-3d4a5336bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:56.067164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdc0e5-a641-464d-9122-3d4a5336bbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:56.067445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdc0e5-a641-464d-9122-3d4a5336bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:56.067722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdc0e5-a641-464d-9122-3d4a5336bbf1 admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:56.081392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fdc0e5-a641-464d-9122-3d4a5336bbf1 admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:56.084062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fdc0e5-a641-464d-9122-3d4a5336bbf1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:56.086329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 682/1346] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:37:56 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:58.266943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2dd61-bb2a-4634-b80a-f61a6a88e8f6 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:58.267511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2dd61-bb2a-4634-b80a-f61a6a88e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:58.267511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2dd61-bb2a-4634-b80a-f61a6a88e8f6 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:58.269955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 665/1347] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:37:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:58.276135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba43ce-3070-4529-9dd7-969d6e3a5e0c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:58.276591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba43ce-3070-4529-9dd7-969d6e3a5e0c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:58.276759 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba43ce-3070-4529-9dd7-969d6e3a5e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:58.294072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-5aba43ce-3070-4529-9dd7-969d6e3a5e0c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:58.295275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5aba43ce-3070-4529-9dd7-969d6e3a5e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:58.303037 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 683/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:37:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:58.327738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2dd61-bb2a-4634-b80a-f61a6a88e8f6 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:58.340345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2dd61-bb2a-4634-b80a-f61a6a88e8f6 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:58.344826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592a3d0-7871-426c-8ea8-15caf3d1bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:58.345658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592a3d0-7871-426c-8ea8-15caf3d1bea8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:58.345937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592a3d0-7871-426c-8ea8-15caf3d1bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:58.346210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592a3d0-7871-426c-8ea8-15caf3d1bea8 admin admin] PATH_INFO: `/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:58.357120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592a3d0-7871-426c-8ea8-15caf3d1bea8 admin admin] RBAC: Authorizing `identity:get_project(project_id=de5d1c3997b74a6dadceb4fb555cf0e6)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:58.359203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592a3d0-7871-426c-8ea8-15caf3d1bea8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:58.360958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 666/1349] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 04:37:58 2021] GET /identity/v3/projects/de5d1c3997b74a6dadceb4fb555cf0e6 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:58.368246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba43ce-3070-4529-9dd7-969d6e3a5e0c None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:58.377306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba43ce-3070-4529-9dd7-969d6e3a5e0c None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:58.382533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49254ee5-eec7-4491-baf9-a33a3e287316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:58.383185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49254ee5-eec7-4491-baf9-a33a3e287316 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:58.383466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49254ee5-eec7-4491-baf9-a33a3e287316 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:58.383876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49254ee5-eec7-4491-baf9-a33a3e287316 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:58.384695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49254ee5-eec7-4491-baf9-a33a3e287316 admin admin] RBAC: Adding query filter params (scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:37:58.385001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49254ee5-eec7-4491-baf9-a33a3e287316 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:58.386872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49254ee5-eec7-4491-baf9-a33a3e287316 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:58.393690 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 684/1350] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 04:37:58 2021] GET /identity/v3/role_assignments?scope.project.id=de5d1c3997b74a6dadceb4fb555cf0e6 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:37:58.400955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592a3d0-7871-426c-8ea8-15caf3d1bea8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:58.410984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592a3d0-7871-426c-8ea8-15caf3d1bea8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:58.415699 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b29ab-8d3d-4a8b-9c3d-9ddd335b7519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:58.416619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b29ab-8d3d-4a8b-9c3d-9ddd335b7519 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:58.416973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b29ab-8d3d-4a8b-9c3d-9ddd335b7519 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:58.417180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b29ab-8d3d-4a8b-9c3d-9ddd335b7519 admin admin] PATH_INFO: `/v3/users/6996fd7dbb564d26aa210e18c1319348` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:58.418413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b29ab-8d3d-4a8b-9c3d-9ddd335b7519 admin admin] RBAC: Authorizing `identity:get_user(user_id=6996fd7dbb564d26aa210e18c1319348)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:58.420593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b29ab-8d3d-4a8b-9c3d-9ddd335b7519 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:58.422239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 667/1351] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:37:58 2021] GET /identity/v3/users/6996fd7dbb564d26aa210e18c1319348 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:37:58.429375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49254ee5-eec7-4491-baf9-a33a3e287316 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:37:58.439477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49254ee5-eec7-4491-baf9-a33a3e287316 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:37:58.444761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f13f6-845c-4c4e-8200-483d8789c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:37:58.445642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f13f6-845c-4c4e-8200-483d8789c834 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:58.445951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f13f6-845c-4c4e-8200-483d8789c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:58.446252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f13f6-845c-4c4e-8200-483d8789c834 admin admin] PATH_INFO: `/v3/users/a3eedbef815445d78eda15afd8ed2501` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:58.447493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f13f6-845c-4c4e-8200-483d8789c834 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3eedbef815445d78eda15afd8ed2501)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:37:58.449402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f13f6-845c-4c4e-8200-483d8789c834 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:37:58.451133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 685/1352] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 04:37:58 2021] GET /identity/v3/users/a3eedbef815445d78eda15afd8ed2501 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:38:03.775796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bece2e-a36e-48aa-8b0b-115621f54da0 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:03.776321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bece2e-a36e-48aa-8b0b-115621f54da0 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:03.776463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bece2e-a36e-48aa-8b0b-115621f54da0 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:03.778169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 668/1353] 10.222.0.25 () {54 vars in 918 bytes} [Fri Aug 27 04:38:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:03.784171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41302ba2-e498-4105-8f25-0591bb4969ec None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:03.784631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41302ba2-e498-4105-8f25-0591bb4969ec None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:03.784798 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41302ba2-e498-4105-8f25-0591bb4969ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:03.802986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-41302ba2-e498-4105-8f25-0591bb4969ec None None] MFA Rules not processed for user `3ef904ebfd2c4372b169ba7804278f19`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:03.804190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-41302ba2-e498-4105-8f25-0591bb4969ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:03.812763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 686/1354] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Aug 27 04:38:03 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:03.828909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fcf46-e7c8-4f06-9592-c28e7feb5560 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:03.829196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fcf46-e7c8-4f06-9592-c28e7feb5560 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:03.829503 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fcf46-e7c8-4f06-9592-c28e7feb5560 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:03.831261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 669/1355] 10.222.0.25 () {54 vars in 918 bytes} [Fri Aug 27 04:38:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:03.837055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9385d71-4d56-4683-90fd-be0f97a8bd8d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:03.837347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9385d71-4d56-4683-90fd-be0f97a8bd8d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:03.837632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9385d71-4d56-4683-90fd-be0f97a8bd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:03.856100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a9385d71-4d56-4683-90fd-be0f97a8bd8d None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:03.857349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a9385d71-4d56-4683-90fd-be0f97a8bd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:03.866480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 687/1356] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Aug 27 04:38:03 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:06.672851 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc4ae-2e6d-449b-9f8d-cd99d1a448f5 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:06.673402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc4ae-2e6d-449b-9f8d-cd99d1a448f5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:06.673402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc4ae-2e6d-449b-9f8d-cd99d1a448f5 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:06.675134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 670/1357] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:06.681777 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac3ef-9511-471c-890e-6978f2050f5b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:06.682260 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac3ef-9511-471c-890e-6978f2050f5b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:06.682356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac3ef-9511-471c-890e-6978f2050f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:06.700965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-3e3ac3ef-9511-471c-890e-6978f2050f5b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:06.702180 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-3e3ac3ef-9511-471c-890e-6978f2050f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:06.710222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 688/1358] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:06.752795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc4ae-2e6d-449b-9f8d-cd99d1a448f5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:06.767215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc4ae-2e6d-449b-9f8d-cd99d1a448f5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:06.772944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8b363-54b7-42d4-924d-4c7080f64667 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:06.773566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b363-54b7-42d4-924d-4c7080f64667 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:06.773844 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b363-54b7-42d4-924d-4c7080f64667 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:06.774118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b363-54b7-42d4-924d-4c7080f64667 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:06.781905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8b363-54b7-42d4-924d-4c7080f64667 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:06.783472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8b363-54b7-42d4-924d-4c7080f64667 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:06.792617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 671/1359] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:08.204898 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044da3c-a906-458a-92a5-a09b81d2532e None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:08.205453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044da3c-a906-458a-92a5-a09b81d2532e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:08.205568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044da3c-a906-458a-92a5-a09b81d2532e None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:08.207255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 689/1360] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 04:38:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:08.213027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c87661-4878-4bc4-a353-c510b594eae7 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:08.213456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c87661-4878-4bc4-a353-c510b594eae7 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:08.213641 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c87661-4878-4bc4-a353-c510b594eae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:08.232216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-02c87661-4878-4bc4-a353-c510b594eae7 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:08.233449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-02c87661-4878-4bc4-a353-c510b594eae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:08.241874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 672/1361] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 04:38:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:38:08.394989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044da3c-a906-458a-92a5-a09b81d2532e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:08.409340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044da3c-a906-458a-92a5-a09b81d2532e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:08.414580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc89bc6-c27e-4944-ad2d-7e5ee3a139f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:08.415205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc89bc6-c27e-4944-ad2d-7e5ee3a139f1 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:08.415485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc89bc6-c27e-4944-ad2d-7e5ee3a139f1 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:08.415759 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc89bc6-c27e-4944-ad2d-7e5ee3a139f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:08.423785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc89bc6-c27e-4944-ad2d-7e5ee3a139f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:08.425377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc89bc6-c27e-4944-ad2d-7e5ee3a139f1 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:08.434947 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 690/1362] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:09.855881 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e808a1a-b024-4b02-b881-f4cf421f230b None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:09.856376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e808a1a-b024-4b02-b881-f4cf421f230b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:09.856475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e808a1a-b024-4b02-b881-f4cf421f230b None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:09.858233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 673/1363] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 04:38:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:09.864713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494be7e6-25c8-4b16-9bae-ac98b35c3b3d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:09.865244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494be7e6-25c8-4b16-9bae-ac98b35c3b3d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:09.865729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494be7e6-25c8-4b16-9bae-ac98b35c3b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:09.885368 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-494be7e6-25c8-4b16-9bae-ac98b35c3b3d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:09.886628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-494be7e6-25c8-4b16-9bae-ac98b35c3b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:09.894690 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 691/1364] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 04:38:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:10.048034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e808a1a-b024-4b02-b881-f4cf421f230b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:10.062907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e808a1a-b024-4b02-b881-f4cf421f230b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:10.068328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3230c-079f-4a1c-a9b0-6aee140149f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:10.068993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3230c-079f-4a1c-a9b0-6aee140149f0 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:10.069275 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3230c-079f-4a1c-a9b0-6aee140149f0 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:10.069551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3230c-079f-4a1c-a9b0-6aee140149f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:10.078083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3230c-079f-4a1c-a9b0-6aee140149f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:10.079836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3230c-079f-4a1c-a9b0-6aee140149f0 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:10.089480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 674/1365] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:11.482578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a7fa3-05ef-4a39-945b-d5ec58253a33 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:11.483139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a7fa3-05ef-4a39-945b-d5ec58253a33 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:11.483139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a7fa3-05ef-4a39-945b-d5ec58253a33 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:11.485082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 692/1366] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 04:38:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:11.491221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835c2ed-2186-4e0b-9693-653683b939e6 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:11.491650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835c2ed-2186-4e0b-9693-653683b939e6 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:11.491775 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835c2ed-2186-4e0b-9693-653683b939e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:11.508963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7835c2ed-2186-4e0b-9693-653683b939e6 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:11.510156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7835c2ed-2186-4e0b-9693-653683b939e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:11.518151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 675/1367] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 04:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:11.673958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a7fa3-05ef-4a39-945b-d5ec58253a33 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:11.689501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a7fa3-05ef-4a39-945b-d5ec58253a33 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:11.695187 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36684882-6b3b-488e-bbcb-d5d517d234ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:11.696047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36684882-6b3b-488e-bbcb-d5d517d234ae service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:11.696154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36684882-6b3b-488e-bbcb-d5d517d234ae service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:11.696480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36684882-6b3b-488e-bbcb-d5d517d234ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:11.705346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36684882-6b3b-488e-bbcb-d5d517d234ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:11.708226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36684882-6b3b-488e-bbcb-d5d517d234ae service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:11.722517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 693/1368] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:38:13.110291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc63a-f6f2-4b09-9f76-9455ea733ebc None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:13.110841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc63a-f6f2-4b09-9f76-9455ea733ebc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:13.110841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc63a-f6f2-4b09-9f76-9455ea733ebc None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:13.112557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 676/1369] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 04:38:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:13.118603 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf6ab4-b8ea-478d-8c26-f7dbe2390482 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:13.119048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf6ab4-b8ea-478d-8c26-f7dbe2390482 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:13.119149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf6ab4-b8ea-478d-8c26-f7dbe2390482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:13.136463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-5aaf6ab4-b8ea-478d-8c26-f7dbe2390482 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:13.137655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5aaf6ab4-b8ea-478d-8c26-f7dbe2390482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:13.145551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 694/1370] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 04:38:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:13.298346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc63a-f6f2-4b09-9f76-9455ea733ebc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:13.313220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc63a-f6f2-4b09-9f76-9455ea733ebc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:13.319061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b6e84-11a4-4923-96e5-5aaec2c1ed71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:13.319289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6e84-11a4-4923-96e5-5aaec2c1ed71 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:13.319593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6e84-11a4-4923-96e5-5aaec2c1ed71 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:13.319889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6e84-11a4-4923-96e5-5aaec2c1ed71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:13.328090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b6e84-11a4-4923-96e5-5aaec2c1ed71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:13.329761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b6e84-11a4-4923-96e5-5aaec2c1ed71 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:13.340308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 677/1371] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:14.747850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b6499-b55f-40d3-be22-dd5739b48a2a None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:14.748380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b6499-b55f-40d3-be22-dd5739b48a2a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:14.748498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b6499-b55f-40d3-be22-dd5739b48a2a None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:14.750294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 695/1372] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 04:38:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:14.756531 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddc65d-9840-481b-b8bf-a2824dccae0a None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:14.756939 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddc65d-9840-481b-b8bf-a2824dccae0a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:14.757164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddc65d-9840-481b-b8bf-a2824dccae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:14.775478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e4ddc65d-9840-481b-b8bf-a2824dccae0a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:14.776743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e4ddc65d-9840-481b-b8bf-a2824dccae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:14.784474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 678/1373] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 04:38:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:14.939752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b6499-b55f-40d3-be22-dd5739b48a2a None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:14.954670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b6499-b55f-40d3-be22-dd5739b48a2a None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:14.960378 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b6494-08df-46aa-b8c5-ca1b8ce5bb28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:14.961061 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6494-08df-46aa-b8c5-ca1b8ce5bb28 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:14.961344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6494-08df-46aa-b8c5-ca1b8ce5bb28 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:14.961620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6494-08df-46aa-b8c5-ca1b8ce5bb28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:14.970191 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6494-08df-46aa-b8c5-ca1b8ce5bb28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:14.971790 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6494-08df-46aa-b8c5-ca1b8ce5bb28 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:14.981165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 696/1374] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:16.389122 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8686e-c47c-4b3e-9de7-f066c3b89885 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:16.389696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8686e-c47c-4b3e-9de7-f066c3b89885 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:16.389696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8686e-c47c-4b3e-9de7-f066c3b89885 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:16.391447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 679/1375] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 04:38:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:16.397911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb79c3-e2ae-4fb3-b0e5-145cbc9e0f09 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:16.398317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb79c3-e2ae-4fb3-b0e5-145cbc9e0f09 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:16.398469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb79c3-e2ae-4fb3-b0e5-145cbc9e0f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:16.416965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-c2eb79c3-e2ae-4fb3-b0e5-145cbc9e0f09 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:16.418184 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c2eb79c3-e2ae-4fb3-b0e5-145cbc9e0f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:16.426064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 697/1376] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 04:38:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:16.576310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8686e-c47c-4b3e-9de7-f066c3b89885 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:16.590888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8686e-c47c-4b3e-9de7-f066c3b89885 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:16.596265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a57e1-ef38-43f7-8de3-a5001b6f36d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:16.596914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a57e1-ef38-43f7-8de3-a5001b6f36d9 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:16.597197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a57e1-ef38-43f7-8de3-a5001b6f36d9 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:16.597473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a57e1-ef38-43f7-8de3-a5001b6f36d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:16.606129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a57e1-ef38-43f7-8de3-a5001b6f36d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:16.607715 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a57e1-ef38-43f7-8de3-a5001b6f36d9 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:16.616735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 680/1377] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:18.067610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188b864-0fb3-4909-841f-feec5d68b435 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:18.068187 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188b864-0fb3-4909-841f-feec5d68b435 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:18.068187 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188b864-0fb3-4909-841f-feec5d68b435 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:18.069893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 698/1378] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 04:38:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:18.075565 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b6a6f-9196-4fcb-a965-20917c285fdf None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:18.076003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b6a6f-9196-4fcb-a965-20917c285fdf None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:18.076155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b6a6f-9196-4fcb-a965-20917c285fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:18.094105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0d2b6a6f-9196-4fcb-a965-20917c285fdf None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:18.095288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0d2b6a6f-9196-4fcb-a965-20917c285fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:18.103718 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 681/1379] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 04:38:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:38:18.259049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188b864-0fb3-4909-841f-feec5d68b435 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:18.274070 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188b864-0fb3-4909-841f-feec5d68b435 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:18.279443 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785106c-51d0-48ef-b2bb-bbc7acce9a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:18.280081 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785106c-51d0-48ef-b2bb-bbc7acce9a4a service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:18.280387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785106c-51d0-48ef-b2bb-bbc7acce9a4a service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:18.280669 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785106c-51d0-48ef-b2bb-bbc7acce9a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:18.288615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785106c-51d0-48ef-b2bb-bbc7acce9a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:18.290185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785106c-51d0-48ef-b2bb-bbc7acce9a4a service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:18.299379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 699/1380] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:19.726637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a89769-2741-4eab-8e85-542c508f896a None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:19.727138 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a89769-2741-4eab-8e85-542c508f896a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:19.727251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a89769-2741-4eab-8e85-542c508f896a None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:19.729044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 682/1381] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 04:38:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:19.734599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4b024-108e-49e7-87ca-68f179143b4a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:19.735016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4b024-108e-49e7-87ca-68f179143b4a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:19.735159 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4b024-108e-49e7-87ca-68f179143b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:19.753145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b6f4b024-108e-49e7-87ca-68f179143b4a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:19.754374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b6f4b024-108e-49e7-87ca-68f179143b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:19.762178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 700/1382] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 04:38:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:19.913678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a89769-2741-4eab-8e85-542c508f896a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:19.928287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a89769-2741-4eab-8e85-542c508f896a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:19.933732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d827c5-fb00-46b3-8bbe-940ef8e16acd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:19.934362 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d827c5-fb00-46b3-8bbe-940ef8e16acd service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:19.934647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d827c5-fb00-46b3-8bbe-940ef8e16acd service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:19.934923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d827c5-fb00-46b3-8bbe-940ef8e16acd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:19.942847 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d827c5-fb00-46b3-8bbe-940ef8e16acd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:19.944465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d827c5-fb00-46b3-8bbe-940ef8e16acd service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:19.953714 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 683/1383] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:22.078177 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c254-f428-471e-b988-b9668bbbf3c5 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.078715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c254-f428-471e-b988-b9668bbbf3c5 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.078715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c254-f428-471e-b988-b9668bbbf3c5 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.080534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 701/1384] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:22.086426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed18672-cd23-4b13-8e4d-5c71adad62b7 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.086869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed18672-cd23-4b13-8e4d-5c71adad62b7 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.086989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed18672-cd23-4b13-8e4d-5c71adad62b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.104912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3ed18672-cd23-4b13-8e4d-5c71adad62b7 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:22.105999 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3ed18672-cd23-4b13-8e4d-5c71adad62b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:22.114453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 684/1385] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:22.153103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98c254-f428-471e-b988-b9668bbbf3c5 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.164241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98c254-f428-471e-b988-b9668bbbf3c5 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:22.167766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf8613-1f1a-4e07-b298-cbd9c4c7a5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:22.168415 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf8613-1f1a-4e07-b298-cbd9c4c7a5dc service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.168698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf8613-1f1a-4e07-b298-cbd9c4c7a5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.169149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf8613-1f1a-4e07-b298-cbd9c4c7a5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.178206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf8613-1f1a-4e07-b298-cbd9c4c7a5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:22.180117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf8613-1f1a-4e07-b298-cbd9c4c7a5dc service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.189863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 702/1386] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:24.497721 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdce3d-43b1-41ea-b5be-7eaae56f1dca None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.498288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdce3d-43b1-41ea-b5be-7eaae56f1dca None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.498288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdce3d-43b1-41ea-b5be-7eaae56f1dca None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.500141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 685/1387] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:24.506008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30e10f-97c1-43bd-9df3-d0136f984ff4 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.506420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30e10f-97c1-43bd-9df3-d0136f984ff4 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.506568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30e10f-97c1-43bd-9df3-d0136f984ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.524040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-3a30e10f-97c1-43bd-9df3-d0136f984ff4 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:24.525249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-3a30e10f-97c1-43bd-9df3-d0136f984ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:24.532925 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 703/1388] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:24.572823 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdce3d-43b1-41ea-b5be-7eaae56f1dca None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.583984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdce3d-43b1-41ea-b5be-7eaae56f1dca None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.587584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d2454-7d0f-4c1b-a34e-f6276333bfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.588225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2454-7d0f-4c1b-a34e-f6276333bfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.588538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2454-7d0f-4c1b-a34e-f6276333bfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.588822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2454-7d0f-4c1b-a34e-f6276333bfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.599216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d2454-7d0f-4c1b-a34e-f6276333bfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.600718 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d2454-7d0f-4c1b-a34e-f6276333bfc9 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.610170 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 686/1389] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:27.198980 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360aebc-1acf-491a-988c-819712241bfd None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.199815 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360aebc-1acf-491a-988c-819712241bfd None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.200026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360aebc-1acf-491a-988c-819712241bfd None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.202097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 704/1390] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:27.208601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2a6bf-406b-4c65-bc17-63b3c1b28c39 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.209037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2a6bf-406b-4c65-bc17-63b3c1b28c39 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.209132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2a6bf-406b-4c65-bc17-63b3c1b28c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.226783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-96c2a6bf-406b-4c65-bc17-63b3c1b28c39 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:27.227988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-96c2a6bf-406b-4c65-bc17-63b3c1b28c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:27.235834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 687/1391] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:27.275968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360aebc-1acf-491a-988c-819712241bfd None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.286567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360aebc-1acf-491a-988c-819712241bfd None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.290185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518e031-abb5-4db1-8a5c-5fbf6b833653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.290821 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518e031-abb5-4db1-8a5c-5fbf6b833653 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.291100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518e031-abb5-4db1-8a5c-5fbf6b833653 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.291371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518e031-abb5-4db1-8a5c-5fbf6b833653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.300810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518e031-abb5-4db1-8a5c-5fbf6b833653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.302151 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518e031-abb5-4db1-8a5c-5fbf6b833653 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.311649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 705/1392] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:29.586753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06fb6f-69b1-4ebc-a1b6-16c8cdc7e701 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.587316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06fb6f-69b1-4ebc-a1b6-16c8cdc7e701 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.587316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06fb6f-69b1-4ebc-a1b6-16c8cdc7e701 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.589142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 688/1393] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:29.595218 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beafdd-8fd9-4d83-9d74-9db537996e33 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.595634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beafdd-8fd9-4d83-9d74-9db537996e33 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.595779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beafdd-8fd9-4d83-9d74-9db537996e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.614787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d4beafdd-8fd9-4d83-9d74-9db537996e33 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:29.616028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d4beafdd-8fd9-4d83-9d74-9db537996e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.623872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 706/1394] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:29.663567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06fb6f-69b1-4ebc-a1b6-16c8cdc7e701 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:29.674097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06fb6f-69b1-4ebc-a1b6-16c8cdc7e701 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:29.679536 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479716b5-3013-4844-b751-ce409bc89579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:29.680549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479716b5-3013-4844-b751-ce409bc89579 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.680951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479716b5-3013-4844-b751-ce409bc89579 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.681237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479716b5-3013-4844-b751-ce409bc89579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.690532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479716b5-3013-4844-b751-ce409bc89579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:29.692018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479716b5-3013-4844-b751-ce409bc89579 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:29.701587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 689/1395] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:31.963839 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ea16f-c3c6-42bd-860d-ade80658ee2b None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.964397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ea16f-c3c6-42bd-860d-ade80658ee2b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.964397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ea16f-c3c6-42bd-860d-ade80658ee2b None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.966079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 707/1396] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:31.972152 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f655a-99af-4fc8-a277-ea09c00891a9 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.972613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f655a-99af-4fc8-a277-ea09c00891a9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.972857 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f655a-99af-4fc8-a277-ea09c00891a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.991257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-fe9f655a-99af-4fc8-a277-ea09c00891a9 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:31.992540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-fe9f655a-99af-4fc8-a277-ea09c00891a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:32.000262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 690/1397] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:32.039293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ea16f-c3c6-42bd-860d-ade80658ee2b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:32.050019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ea16f-c3c6-42bd-860d-ade80658ee2b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:32.054041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eab0a-2247-4d8b-a0f6-f0b110659830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:32.054675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eab0a-2247-4d8b-a0f6-f0b110659830 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.054962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eab0a-2247-4d8b-a0f6-f0b110659830 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.055241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eab0a-2247-4d8b-a0f6-f0b110659830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.064246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eab0a-2247-4d8b-a0f6-f0b110659830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:32.065808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eab0a-2247-4d8b-a0f6-f0b110659830 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:32.075956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 708/1398] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:38:34.248963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30247fa9-96e1-46e2-81ab-82d0c4f1de7b None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.249497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30247fa9-96e1-46e2-81ab-82d0c4f1de7b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.249497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30247fa9-96e1-46e2-81ab-82d0c4f1de7b None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.251340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 691/1399] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:34.257480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2142670-971d-43b6-8f60-dbbe539ad158 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.257929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2142670-971d-43b6-8f60-dbbe539ad158 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.258041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2142670-971d-43b6-8f60-dbbe539ad158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.276210 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b2142670-971d-43b6-8f60-dbbe539ad158 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:34.277429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b2142670-971d-43b6-8f60-dbbe539ad158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:34.286034 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 709/1400] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:34.324992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30247fa9-96e1-46e2-81ab-82d0c4f1de7b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.335833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30247fa9-96e1-46e2-81ab-82d0c4f1de7b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.339301 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d106b9-8be4-40a4-ba3d-e9e473d3c60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.339922 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d106b9-8be4-40a4-ba3d-e9e473d3c60d service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.340203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d106b9-8be4-40a4-ba3d-e9e473d3c60d service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.340518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d106b9-8be4-40a4-ba3d-e9e473d3c60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.349910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d106b9-8be4-40a4-ba3d-e9e473d3c60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.351363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d106b9-8be4-40a4-ba3d-e9e473d3c60d service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.360953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 692/1401] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:36.556221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d128bb-852f-4968-8571-e0ecd070f727 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.556838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d128bb-852f-4968-8571-e0ecd070f727 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.556838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d128bb-852f-4968-8571-e0ecd070f727 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.558587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 710/1402] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:38:36.565129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe6497-defd-474c-89c1-66151656fed1 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.565651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe6497-defd-474c-89c1-66151656fed1 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.565651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe6497-defd-474c-89c1-66151656fed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.584420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-a6fe6497-defd-474c-89c1-66151656fed1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:36.585635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a6fe6497-defd-474c-89c1-66151656fed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.593546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 693/1403] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:36.632716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d128bb-852f-4968-8571-e0ecd070f727 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:36.643186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d128bb-852f-4968-8571-e0ecd070f727 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:36.646659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f0761-064c-4ee8-854f-df8f8e05af62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:36.647547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f0761-064c-4ee8-854f-df8f8e05af62 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.647825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f0761-064c-4ee8-854f-df8f8e05af62 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.648097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f0761-064c-4ee8-854f-df8f8e05af62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.657398 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f0761-064c-4ee8-854f-df8f8e05af62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:36.658850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f0761-064c-4ee8-854f-df8f8e05af62 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:36.668725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 711/1404] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:38.891879 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa3dfe-d8b4-4e22-bef4-1bab1be2fcb6 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:38.892447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa3dfe-d8b4-4e22-bef4-1bab1be2fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:38.892447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa3dfe-d8b4-4e22-bef4-1bab1be2fcb6 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:38.894756 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 694/1405] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:38.901249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24e569-5f29-49c7-a837-4c8a84f4f048 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:38.901773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24e569-5f29-49c7-a837-4c8a84f4f048 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:38.901868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24e569-5f29-49c7-a837-4c8a84f4f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:38.920165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-5c24e569-5f29-49c7-a837-4c8a84f4f048 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:38.921415 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5c24e569-5f29-49c7-a837-4c8a84f4f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:38.929318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 712/1406] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:38.967505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa3dfe-d8b4-4e22-bef4-1bab1be2fcb6 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:38.978961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa3dfe-d8b4-4e22-bef4-1bab1be2fcb6 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:38.982581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891ff0f-3f67-4ebc-9fd5-7fbbddf2e175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:38.983251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ff0f-3f67-4ebc-9fd5-7fbbddf2e175 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:38.983554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ff0f-3f67-4ebc-9fd5-7fbbddf2e175 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:38.983851 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ff0f-3f67-4ebc-9fd5-7fbbddf2e175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:38.992899 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891ff0f-3f67-4ebc-9fd5-7fbbddf2e175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:38.994342 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891ff0f-3f67-4ebc-9fd5-7fbbddf2e175 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:39.003978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 695/1407] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:41.173067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034718d9-df3e-4992-89d1-43b4ece5ed10 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.173615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034718d9-df3e-4992-89d1-43b4ece5ed10 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.173615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034718d9-df3e-4992-89d1-43b4ece5ed10 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.175895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 713/1408] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:41.182609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babccb-afb7-425e-9d9a-49ec6312b358 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.183095 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babccb-afb7-425e-9d9a-49ec6312b358 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.183206 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babccb-afb7-425e-9d9a-49ec6312b358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.201439 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-22babccb-afb7-425e-9d9a-49ec6312b358 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:41.202653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-22babccb-afb7-425e-9d9a-49ec6312b358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.210517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 696/1409] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:41.247899 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034718d9-df3e-4992-89d1-43b4ece5ed10 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:41.259018 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034718d9-df3e-4992-89d1-43b4ece5ed10 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:41.262770 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0ae50-4a9b-41f2-8581-2a8f45c821e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.263409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0ae50-4a9b-41f2-8581-2a8f45c821e0 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.263689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0ae50-4a9b-41f2-8581-2a8f45c821e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.263960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0ae50-4a9b-41f2-8581-2a8f45c821e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.273204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0ae50-4a9b-41f2-8581-2a8f45c821e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:41.274630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0ae50-4a9b-41f2-8581-2a8f45c821e0 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:41.283700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 714/1410] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:43.462598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2780bd-6b9e-46ac-abba-a635680d294b None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:43.463249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2780bd-6b9e-46ac-abba-a635680d294b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:43.463249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2780bd-6b9e-46ac-abba-a635680d294b None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:43.464966 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 697/1411] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:38:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:43.471171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f1a5b-2734-4131-8590-b95c3f079645 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:43.471656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f1a5b-2734-4131-8590-b95c3f079645 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:43.471809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f1a5b-2734-4131-8590-b95c3f079645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:43.489804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-600f1a5b-2734-4131-8590-b95c3f079645 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:43.491031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-600f1a5b-2734-4131-8590-b95c3f079645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:43.498852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 715/1412] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:38:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:43.537191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2780bd-6b9e-46ac-abba-a635680d294b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:43.548083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2780bd-6b9e-46ac-abba-a635680d294b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:43.551640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4ed82-474f-4892-a4a0-a50cb8e57cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:43.552277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ed82-474f-4892-a4a0-a50cb8e57cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:43.552599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ed82-474f-4892-a4a0-a50cb8e57cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:43.552875 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ed82-474f-4892-a4a0-a50cb8e57cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:43.562247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4ed82-474f-4892-a4a0-a50cb8e57cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:43.563705 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4ed82-474f-4892-a4a0-a50cb8e57cc0 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:43.573293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 698/1413] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:38:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:00.474224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56619f-c405-49b3-af08-30a4bbb82650 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.474799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56619f-c405-49b3-af08-30a4bbb82650 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.474799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56619f-c405-49b3-af08-30a4bbb82650 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.476585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 716/1414] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:39:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:39:00.482510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32640c13-a93c-4f6e-825b-33c96f839068 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.482950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32640c13-a93c-4f6e-825b-33c96f839068 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.483049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32640c13-a93c-4f6e-825b-33c96f839068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.501104 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-32640c13-a93c-4f6e-825b-33c96f839068 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:00.502292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-32640c13-a93c-4f6e-825b-33c96f839068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:00.509897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 699/1415] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:39:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:00.558653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b4154-73f3-4d6b-bc15-481475822c23 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.558971 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b4154-73f3-4d6b-bc15-481475822c23 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.559254 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b4154-73f3-4d6b-bc15-481475822c23 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.561098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 717/1416] 10.222.0.25 () {54 vars in 966 bytes} [Fri Aug 27 04:39:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:00.566355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33282a73-4586-4ab2-850f-70c1fa232340 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.566644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33282a73-4586-4ab2-850f-70c1fa232340 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.566923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33282a73-4586-4ab2-850f-70c1fa232340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.585515 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-33282a73-4586-4ab2-850f-70c1fa232340 None None] MFA Rules not processed for user `9f041d8d6b5949c48920b729511f3783`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:00.586701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-33282a73-4586-4ab2-850f-70c1fa232340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:00.593082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 700/1417] 10.222.0.25 () {58 vars in 1064 bytes} [Fri Aug 27 04:39:00 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:00.601298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b4154-73f3-4d6b-bc15-481475822c23 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.611915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b4154-73f3-4d6b-bc15-481475822c23 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.615399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4859c-9a21-455c-85ec-37a9669c2cb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f041d8d6b5949c48920b729511f3783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.616028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4859c-9a21-455c-85ec-37a9669c2cb9 service glance] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.616312 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4859c-9a21-455c-85ec-37a9669c2cb9 service glance] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.616619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4859c-9a21-455c-85ec-37a9669c2cb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.625315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4859c-9a21-455c-85ec-37a9669c2cb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.626762 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4859c-9a21-455c-85ec-37a9669c2cb9 service glance] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.636204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 718/1418] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:39:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:02.864325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79990101-7b3a-4e0b-948a-bf18dfd33690 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.864907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79990101-7b3a-4e0b-948a-bf18dfd33690 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.864907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79990101-7b3a-4e0b-948a-bf18dfd33690 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.866656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 701/1419] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:39:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:02.872523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab191213-95f4-481e-b474-0e68fb4d54b5 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.872972 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab191213-95f4-481e-b474-0e68fb4d54b5 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.873100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab191213-95f4-481e-b474-0e68fb4d54b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.891167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ab191213-95f4-481e-b474-0e68fb4d54b5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:02.892534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ab191213-95f4-481e-b474-0e68fb4d54b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:02.900469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 719/1420] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:39:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:02.925764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79990101-7b3a-4e0b-948a-bf18dfd33690 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:02.937976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79990101-7b3a-4e0b-948a-bf18dfd33690 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:02.943010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ae510-2f44-4fb3-a149-37cfff885455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:02.943647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ae510-2f44-4fb3-a149-37cfff885455 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.943928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ae510-2f44-4fb3-a149-37cfff885455 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.944203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ae510-2f44-4fb3-a149-37cfff885455 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.944967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ae510-2f44-4fb3-a149-37cfff885455 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:02.946908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ae510-2f44-4fb3-a149-37cfff885455 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:02.960346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 702/1421] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 04:39:02 2021] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:05.124794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16bfe4-a500-443c-a2da-1a8a00eceb64 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:05.125311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16bfe4-a500-443c-a2da-1a8a00eceb64 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:05.125311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16bfe4-a500-443c-a2da-1a8a00eceb64 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:05.127109 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 720/1422] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:39:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:05.133126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49366-5194-4944-b6ae-b7730411b4e1 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:05.133524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49366-5194-4944-b6ae-b7730411b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:05.133737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49366-5194-4944-b6ae-b7730411b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:05.152070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7ac49366-5194-4944-b6ae-b7730411b4e1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:05.155505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7ac49366-5194-4944-b6ae-b7730411b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:05.162007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 703/1423] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:39:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:05.205960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16bfe4-a500-443c-a2da-1a8a00eceb64 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:05.220230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16bfe4-a500-443c-a2da-1a8a00eceb64 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:05.226227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d845e1-813c-4d7c-a9fb-60e5ec729920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:05.226858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d845e1-813c-4d7c-a9fb-60e5ec729920 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:05.227142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d845e1-813c-4d7c-a9fb-60e5ec729920 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:05.227418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d845e1-813c-4d7c-a9fb-60e5ec729920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:05.235340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d845e1-813c-4d7c-a9fb-60e5ec729920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:05.236988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d845e1-813c-4d7c-a9fb-60e5ec729920 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:05.246123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 721/1424] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:39:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:07.572232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ee99-3c2b-4d06-830e-c056d4cf6521 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:07.572838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ee99-3c2b-4d06-830e-c056d4cf6521 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:07.572838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ee99-3c2b-4d06-830e-c056d4cf6521 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:07.574619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 704/1425] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:39:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:07.580568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be6b12-b3e4-4beb-a3a5-cc0c4ed3c61d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:07.581025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be6b12-b3e4-4beb-a3a5-cc0c4ed3c61d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:07.581132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be6b12-b3e4-4beb-a3a5-cc0c4ed3c61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:07.598319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-07be6b12-b3e4-4beb-a3a5-cc0c4ed3c61d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:07.599460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-07be6b12-b3e4-4beb-a3a5-cc0c4ed3c61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:07.607177 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 722/1426] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:39:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:07.644486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ee99-3c2b-4d06-830e-c056d4cf6521 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:07.655457 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ee99-3c2b-4d06-830e-c056d4cf6521 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:07.658958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6d4bf-f94f-4717-bae3-ce0a28f935ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:07.659593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6d4bf-f94f-4717-bae3-ce0a28f935ee service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:07.659867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6d4bf-f94f-4717-bae3-ce0a28f935ee service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:07.660141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6d4bf-f94f-4717-bae3-ce0a28f935ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:07.669082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6d4bf-f94f-4717-bae3-ce0a28f935ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:07.670515 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6d4bf-f94f-4717-bae3-ce0a28f935ee service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:07.680560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 705/1427] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:39:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:09.902161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49eefc-2a43-46ac-842a-59861363aeb3 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:09.902649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49eefc-2a43-46ac-842a-59861363aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:09.902765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49eefc-2a43-46ac-842a-59861363aeb3 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:09.904688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 723/1428] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:39:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:09.910710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7d7d5-b008-4388-a711-87a3bf772dff None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:09.911150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7d7d5-b008-4388-a711-87a3bf772dff None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:09.911244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7d7d5-b008-4388-a711-87a3bf772dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:09.929774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d9a7d7d5-b008-4388-a711-87a3bf772dff None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:09.930966 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d9a7d7d5-b008-4388-a711-87a3bf772dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:09.938674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 706/1429] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:39:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:09.978505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49eefc-2a43-46ac-842a-59861363aeb3 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:09.989647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49eefc-2a43-46ac-842a-59861363aeb3 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:09.993153 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f828d80-437a-41f7-a477-34f9a499669f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:09.993783 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f828d80-437a-41f7-a477-34f9a499669f service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:09.994063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f828d80-437a-41f7-a477-34f9a499669f service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:09.994338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f828d80-437a-41f7-a477-34f9a499669f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.003534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f828d80-437a-41f7-a477-34f9a499669f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:10.004989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f828d80-437a-41f7-a477-34f9a499669f service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:10.014008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 724/1430] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:39:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:12.391023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9d4c-5522-4d9e-8c34-c06f8394680d None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.391591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9d4c-5522-4d9e-8c34-c06f8394680d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:12.391591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9d4c-5522-4d9e-8c34-c06f8394680d None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.393367 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 707/1431] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:39:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:12.403807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df86b84-bdd2-4fed-990f-adad2d638a67 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.404491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df86b84-bdd2-4fed-990f-adad2d638a67 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:12.404841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df86b84-bdd2-4fed-990f-adad2d638a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.434672 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-7df86b84-bdd2-4fed-990f-adad2d638a67 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:12.435885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7df86b84-bdd2-4fed-990f-adad2d638a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:12.444054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 725/1432] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:39:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:12.485243 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba9d4c-5522-4d9e-8c34-c06f8394680d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:12.496783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba9d4c-5522-4d9e-8c34-c06f8394680d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:12.500298 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411423c0-79c8-4dc2-b21d-03a40250c6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:12.500965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411423c0-79c8-4dc2-b21d-03a40250c6ef service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.501244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411423c0-79c8-4dc2-b21d-03a40250c6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:12.501521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411423c0-79c8-4dc2-b21d-03a40250c6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.511360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411423c0-79c8-4dc2-b21d-03a40250c6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:12.512943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411423c0-79c8-4dc2-b21d-03a40250c6ef service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:12.523073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 708/1433] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:39:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:15.063093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1809-a933-418b-8809-02dfb9127e87 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:15.063659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1809-a933-418b-8809-02dfb9127e87 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:15.063659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1809-a933-418b-8809-02dfb9127e87 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:15.065996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 726/1434] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 04:39:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:15.072277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19108-befe-4fd4-88f9-38b5a3623f47 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:15.072796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19108-befe-4fd4-88f9-38b5a3623f47 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:15.072913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19108-befe-4fd4-88f9-38b5a3623f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:15.090135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-54a19108-befe-4fd4-88f9-38b5a3623f47 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:15.091338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-54a19108-befe-4fd4-88f9-38b5a3623f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:15.099047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 709/1435] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 04:39:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:15.138866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec1809-a933-418b-8809-02dfb9127e87 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:15.149666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec1809-a933-418b-8809-02dfb9127e87 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:15.153190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35105e-f091-47ec-8f5e-7f328a03903e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:15.153821 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35105e-f091-47ec-8f5e-7f328a03903e service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:15.154102 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35105e-f091-47ec-8f5e-7f328a03903e service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:15.154380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35105e-f091-47ec-8f5e-7f328a03903e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:15.163348 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35105e-f091-47ec-8f5e-7f328a03903e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:15.164859 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35105e-f091-47ec-8f5e-7f328a03903e service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:15.175422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 727/1436] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:39:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:35.726860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876be83-ce0d-4987-b9e7-19395f202f54 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.727329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876be83-ce0d-4987-b9e7-19395f202f54 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.727427 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876be83-ce0d-4987-b9e7-19395f202f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.745129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0876be83-ce0d-4987-b9e7-19395f202f54 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:35.746305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0876be83-ce0d-4987-b9e7-19395f202f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:35.754424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 710/1437] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:35.762592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3801a-a5ba-4cda-8388-4228bbb88c51 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.763107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3801a-a5ba-4cda-8388-4228bbb88c51 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.763215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3801a-a5ba-4cda-8388-4228bbb88c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.781435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d6b3801a-a5ba-4cda-8388-4228bbb88c51 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:35.782626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d6b3801a-a5ba-4cda-8388-4228bbb88c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:35.790381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 728/1438] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:40:35.795577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876be83-ce0d-4987-b9e7-19395f202f54 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:35.805827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876be83-ce0d-4987-b9e7-19395f202f54 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:35.810535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f34086-0d41-486a-a8ac-c49206217205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:35.811182 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f34086-0d41-486a-a8ac-c49206217205 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.811466 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f34086-0d41-486a-a8ac-c49206217205 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.811743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f34086-0d41-486a-a8ac-c49206217205 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.812510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f34086-0d41-486a-a8ac-c49206217205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:40:35.812819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f34086-0d41-486a-a8ac-c49206217205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:35.815053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f34086-0d41-486a-a8ac-c49206217205 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:35.826316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 711/1439] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:40:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:35.834348 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3801a-a5ba-4cda-8388-4228bbb88c51 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:35.843270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3801a-a5ba-4cda-8388-4228bbb88c51 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:35.847834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78833e-82fb-469a-8cef-c4a3b0ecbc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:35.848511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78833e-82fb-469a-8cef-c4a3b0ecbc16 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.848793 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78833e-82fb-469a-8cef-c4a3b0ecbc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.849067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78833e-82fb-469a-8cef-c4a3b0ecbc16 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.849751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78833e-82fb-469a-8cef-c4a3b0ecbc16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:35.851646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78833e-82fb-469a-8cef-c4a3b0ecbc16 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:35.991421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 729/1440] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:40:35 2021] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:35.995882 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f34086-0d41-486a-a8ac-c49206217205 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:36.006559 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f34086-0d41-486a-a8ac-c49206217205 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:36.062297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a76f7d-71ac-4225-8c55-cef7c3aeaead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:36.062977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a76f7d-71ac-4225-8c55-cef7c3aeaead admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.063262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a76f7d-71ac-4225-8c55-cef7c3aeaead admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.064097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a76f7d-71ac-4225-8c55-cef7c3aeaead admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.064836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a76f7d-71ac-4225-8c55-cef7c3aeaead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:36.066779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a76f7d-71ac-4225-8c55-cef7c3aeaead admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:36.212303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 712/1441] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:40:35 2021] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:36.216579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78833e-82fb-469a-8cef-c4a3b0ecbc16 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:36.226898 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78833e-82fb-469a-8cef-c4a3b0ecbc16 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:36.231372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a15cc-7616-4a81-98ed-ecfc8946a688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:36.232023 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a15cc-7616-4a81-98ed-ecfc8946a688 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.232299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a15cc-7616-4a81-98ed-ecfc8946a688 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.232599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a15cc-7616-4a81-98ed-ecfc8946a688 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.233312 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a15cc-7616-4a81-98ed-ecfc8946a688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:36.234910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a15cc-7616-4a81-98ed-ecfc8946a688 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:36.248388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 730/1442] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:40:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:36.252237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a76f7d-71ac-4225-8c55-cef7c3aeaead admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:36.262231 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a76f7d-71ac-4225-8c55-cef7c3aeaead admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:36.266831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec54094-95e8-40f7-b080-4e2ffa2aa954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:36.267499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec54094-95e8-40f7-b080-4e2ffa2aa954 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.267783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec54094-95e8-40f7-b080-4e2ffa2aa954 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.268057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec54094-95e8-40f7-b080-4e2ffa2aa954 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.268940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec54094-95e8-40f7-b080-4e2ffa2aa954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:36.270799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec54094-95e8-40f7-b080-4e2ffa2aa954 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:36.284451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 713/1443] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:40:36 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:36.288614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a15cc-7616-4a81-98ed-ecfc8946a688 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:36.298960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a15cc-7616-4a81-98ed-ecfc8946a688 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:36.303499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888165-69f6-4456-aaff-0293700c789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:36.304401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888165-69f6-4456-aaff-0293700c789a admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.304689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888165-69f6-4456-aaff-0293700c789a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.304965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888165-69f6-4456-aaff-0293700c789a admin admin] PATH_INFO: `/v3/projects/162db381be134df0a3ca4b1bd3551c99/users/3b46a4ef3fac49469a2debc87edb81fa/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.318871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96888165-69f6-4456-aaff-0293700c789a admin admin] RBAC: Authorizing `identity:create_grant(project_id=162db381be134df0a3ca4b1bd3551c99, user_id=3b46a4ef3fac49469a2debc87edb81fa, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:36.321578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96888165-69f6-4456-aaff-0293700c789a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:36.400857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 731/1444] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:40:36 2021] PUT /identity/v3/projects/162db381be134df0a3ca4b1bd3551c99/users/3b46a4ef3fac49469a2debc87edb81fa/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:40:36.413498 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fc5f5-5bfd-4fca-9bee-7af096fd2206 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.413783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fc5f5-5bfd-4fca-9bee-7af096fd2206 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.414059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fc5f5-5bfd-4fca-9bee-7af096fd2206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.439492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-550fc5f5-5bfd-4fca-9bee-7af096fd2206 None None] MFA Rules not processed for user `3b46a4ef3fac49469a2debc87edb81fa`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:36.440717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-550fc5f5-5bfd-4fca-9bee-7af096fd2206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:36.501153 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 714/1445] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:40:36 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:36.512569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888165-69f6-4456-aaff-0293700c789a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:36.582526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888165-69f6-4456-aaff-0293700c789a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:36.587900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae9ca5-dbbe-466b-8196-d6a597cd6ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:36.588567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae9ca5-dbbe-466b-8196-d6a597cd6ec9 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.588846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae9ca5-dbbe-466b-8196-d6a597cd6ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.589121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae9ca5-dbbe-466b-8196-d6a597cd6ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.597261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae9ca5-dbbe-466b-8196-d6a597cd6ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:36.598858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae9ca5-dbbe-466b-8196-d6a597cd6ec9 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:36.607378 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 732/1446] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:40:36 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:36.677437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16858947-37f6-4221-9774-a0cf8249377a None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.677437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16858947-37f6-4221-9774-a0cf8249377a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.677437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16858947-37f6-4221-9774-a0cf8249377a None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.685669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 715/1447] 10.222.0.25 () {52 vars in 829 bytes} [Fri Aug 27 04:40:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:40:36.685761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae9ca5-dbbe-466b-8196-d6a597cd6ec9 service nova] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:36.792207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae9ca5-dbbe-466b-8196-d6a597cd6ec9 service nova] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:36.796924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:36.797816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.798097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.798370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] PATH_INFO: `/v3/users/3b46a4ef3fac49469a2debc87edb81fa` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.799547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b46a4ef3fac49469a2debc87edb81fa)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:36.800593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:40:36.800593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:40:36.800593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:40:36.801825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:37.032115 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b46a4ef3fac49469a2debc87edb81fa'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:37.052106 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b46a4ef3fac49469a2debc87edb81fa'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:37.052106 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b46a4ef3fac49469a2debc87edb81fa'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:37.065196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b46a4ef3fac49469a2debc87edb81fa'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:37.149486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b46a4ef3fac49469a2debc87edb81fa'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:37.156336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 733/1448] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:40:36 2021] DELETE /identity/v3/users/3b46a4ef3fac49469a2debc87edb81fa => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:37.160974 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc40f9-c1bd-469a-91f9-376c1f6ca389 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:37.165874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc40f9-c1bd-469a-91f9-376c1f6ca389 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:37.165874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc40f9-c1bd-469a-91f9-376c1f6ca389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:37.179423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-67fc40f9-c1bd-469a-91f9-376c1f6ca389 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:37.180678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-67fc40f9-c1bd-469a-91f9-376c1f6ca389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:37.237584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 716/1449] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:40:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:37.247806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:37.249368 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:37.304555 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b979e-c6ff-4019-be60-2175fef20477 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:37.308124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101309e8-308d-4277-9058-d0ef83c21188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:37.308816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101309e8-308d-4277-9058-d0ef83c21188 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:37.309090 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101309e8-308d-4277-9058-d0ef83c21188 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:37.309370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101309e8-308d-4277-9058-d0ef83c21188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:37.318826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101309e8-308d-4277-9058-d0ef83c21188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:37.322201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101309e8-308d-4277-9058-d0ef83c21188 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:37.329478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 734/1450] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:40:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:37.909373 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc40f9-c1bd-469a-91f9-376c1f6ca389 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:37.910957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-67fc40f9-c1bd-469a-91f9-376c1f6ca389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:37.923776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc40f9-c1bd-469a-91f9-376c1f6ca389 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:37.928704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:37.929552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:37.929831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:37.930200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] PATH_INFO: `/v3/projects/162db381be134df0a3ca4b1bd3551c99` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:37.931356 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=162db381be134df0a3ca4b1bd3551c99)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:37.933173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:40:37.933173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:40:37.933173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:40:37.934388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:38.050284 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162db381be134df0a3ca4b1bd3551c99', 'request_id': 'req-55fc7d8c-e66f-44ae-826c-7edc931a76c6'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:38.137609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162db381be134df0a3ca4b1bd3551c99', 'request_id': 'req-55fc7d8c-e66f-44ae-826c-7edc931a76c6'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:38.145047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162db381be134df0a3ca4b1bd3551c99', 'request_id': 'req-55fc7d8c-e66f-44ae-826c-7edc931a76c6'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:38.165964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] The token cache is being invalidate because project 162db381be134df0a3ca4b1bd3551c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:38.166598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:38.166826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-55fc7d8c-e66f-44ae-826c-7edc931a76c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:38.168475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 717/1451] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:40:37 2021] DELETE /identity/v3/projects/162db381be134df0a3ca4b1bd3551c99 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:08.492076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f697de-b09f-4e42-91e0-7c0a917d9dc2 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:08.492726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f697de-b09f-4e42-91e0-7c0a917d9dc2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:08.492726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f697de-b09f-4e42-91e0-7c0a917d9dc2 None None] PATH_INFO: `/v3` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:08.493983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 735/1452] 10.222.0.43 () {54 vars in 926 bytes} [Fri Aug 27 04:42:08 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:42:08.501264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b171e-61bf-44eb-bd15-f076c7021a16 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:08.501812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b171e-61bf-44eb-bd15-f076c7021a16 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:08.501812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b171e-61bf-44eb-bd15-f076c7021a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:08.520014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-362b171e-61bf-44eb-bd15-f076c7021a16 None None] MFA Rules not processed for user `3ef904ebfd2c4372b169ba7804278f19`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:08.521283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-362b171e-61bf-44eb-bd15-f076c7021a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:08.581558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 718/1453] 10.222.0.43 () {58 vars in 1016 bytes} [Fri Aug 27 04:42:08 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:09.377332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9665-4d16-45fa-9ba2-0d1b63b38412 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:09.377623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9665-4d16-45fa-9ba2-0d1b63b38412 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:09.377909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9665-4d16-45fa-9ba2-0d1b63b38412 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:09.379903 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 736/1454] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 04:42:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:42:09.386534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b421b-67e2-420a-a8d6-f9f1042fa71b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:09.386825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b421b-67e2-420a-a8d6-f9f1042fa71b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:09.387202 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b421b-67e2-420a-a8d6-f9f1042fa71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:09.408236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-5e7b421b-67e2-420a-a8d6-f9f1042fa71b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:09.409453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5e7b421b-67e2-420a-a8d6-f9f1042fa71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:09.473518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 719/1455] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 04:42:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:42:09.630241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b9665-4d16-45fa-9ba2-0d1b63b38412 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:09.631864 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-401b9665-4d16-45fa-9ba2-0d1b63b38412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:09.705069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b9665-4d16-45fa-9ba2-0d1b63b38412 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:09.710509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6891c-c36d-47dd-9fac-c067c5907491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:09.711196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6891c-c36d-47dd-9fac-c067c5907491 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:09.711480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6891c-c36d-47dd-9fac-c067c5907491 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:09.711755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6891c-c36d-47dd-9fac-c067c5907491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:09.720345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6891c-c36d-47dd-9fac-c067c5907491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:09.721954 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6891c-c36d-47dd-9fac-c067c5907491 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:09.731534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 737/1456] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:42:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:11.086862 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11498-d6c1-466c-9227-423efdf9bbbf None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:11.087421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11498-d6c1-466c-9227-423efdf9bbbf None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:11.087421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11498-d6c1-466c-9227-423efdf9bbbf None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:11.089159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 720/1457] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 04:42:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:42:11.094619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23e1e1-2f8c-4f5e-a112-31fd626a63d9 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:11.095077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23e1e1-2f8c-4f5e-a112-31fd626a63d9 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:11.095178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23e1e1-2f8c-4f5e-a112-31fd626a63d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:11.115601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-af23e1e1-2f8c-4f5e-a112-31fd626a63d9 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:11.116853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-af23e1e1-2f8c-4f5e-a112-31fd626a63d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:11.125360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 738/1458] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 04:42:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:11.280011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d11498-d6c1-466c-9227-423efdf9bbbf None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:11.294976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d11498-d6c1-466c-9227-423efdf9bbbf None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:11.300622 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8e5e-d469-4661-8d7a-be596a7d8c11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:11.301284 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8e5e-d469-4661-8d7a-be596a7d8c11 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:11.301599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8e5e-d469-4661-8d7a-be596a7d8c11 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:11.301908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8e5e-d469-4661-8d7a-be596a7d8c11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:11.310584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f8e5e-d469-4661-8d7a-be596a7d8c11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:11.312282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f8e5e-d469-4661-8d7a-be596a7d8c11 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:11.321803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 721/1459] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:42:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:12.298746 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8f23e-14ae-402c-bb7e-e75636a4bfc7 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:12.299619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8f23e-14ae-402c-bb7e-e75636a4bfc7 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:12.299619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8f23e-14ae-402c-bb7e-e75636a4bfc7 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:12.301201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 739/1460] 10.222.0.25 () {54 vars in 960 bytes} [Fri Aug 27 04:42:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:42:12.306935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93513-deb2-436f-835e-0b43f2a4df8c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:12.308015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93513-deb2-436f-835e-0b43f2a4df8c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:12.308015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93513-deb2-436f-835e-0b43f2a4df8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:12.326430 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-48d93513-deb2-436f-835e-0b43f2a4df8c None None] MFA Rules not processed for user `3ef904ebfd2c4372b169ba7804278f19`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:12.327638 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-48d93513-deb2-436f-835e-0b43f2a4df8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:12.336170 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 722/1461] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Aug 27 04:42:12 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:12.344246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8f23e-14ae-402c-bb7e-e75636a4bfc7 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:12.357660 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8f23e-14ae-402c-bb7e-e75636a4bfc7 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:12.362576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d05cd4-5d2b-4a5a-a941-03e46d9abba6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:12.363248 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05cd4-5d2b-4a5a-a941-03e46d9abba6 service placement] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:12.363532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05cd4-5d2b-4a5a-a941-03e46d9abba6 service placement] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:12.363812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05cd4-5d2b-4a5a-a941-03e46d9abba6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:12.372647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d05cd4-5d2b-4a5a-a941-03e46d9abba6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:12.374245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d05cd4-5d2b-4a5a-a941-03e46d9abba6 service placement] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:12.383828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 740/1462] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:42:12 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:42:23.091967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b39f3-d92b-4bab-bd61-41079e175caf None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:23.092562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b39f3-d92b-4bab-bd61-41079e175caf None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:23.092562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b39f3-d92b-4bab-bd61-41079e175caf None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:23.094307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 723/1463] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 04:42:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:42:23.099774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ad415-30b0-4c6d-8051-64ce7c7eac2a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:23.102078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ad415-30b0-4c6d-8051-64ce7c7eac2a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:23.102078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ad415-30b0-4c6d-8051-64ce7c7eac2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:23.119036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-c40ad415-30b0-4c6d-8051-64ce7c7eac2a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:23.120245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c40ad415-30b0-4c6d-8051-64ce7c7eac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:23.128487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 741/1464] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 04:42:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:23.289038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b39f3-d92b-4bab-bd61-41079e175caf None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:23.303231 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b39f3-d92b-4bab-bd61-41079e175caf None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:23.308731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6ff28-d190-4fce-bba7-6ca8108ad612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:23.313845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6ff28-d190-4fce-bba7-6ca8108ad612 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:23.313845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6ff28-d190-4fce-bba7-6ca8108ad612 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:23.313845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6ff28-d190-4fce-bba7-6ca8108ad612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:23.317985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6ff28-d190-4fce-bba7-6ca8108ad612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:23.319577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6ff28-d190-4fce-bba7-6ca8108ad612 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:23.329549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 724/1465] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:42:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:42:24.702046 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1d60e-b69e-43e3-91e2-c20a1a5b85b6 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:24.702717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1d60e-b69e-43e3-91e2-c20a1a5b85b6 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:24.702987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1d60e-b69e-43e3-91e2-c20a1a5b85b6 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:24.704989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 742/1466] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 04:42:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:42:24.710281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2d6b-0cad-418e-af13-f6b80d703453 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:24.710710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2d6b-0cad-418e-af13-f6b80d703453 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:24.710874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2d6b-0cad-418e-af13-f6b80d703453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:24.729094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-39fd2d6b-0cad-418e-af13-f6b80d703453 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:24.730294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-39fd2d6b-0cad-418e-af13-f6b80d703453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:24.738016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 725/1467] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 04:42:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:24.899748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1d60e-b69e-43e3-91e2-c20a1a5b85b6 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:24.914416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1d60e-b69e-43e3-91e2-c20a1a5b85b6 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:24.919754 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526748b-e3ed-41d2-a2c1-3d60ba8e11b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:24.920412 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526748b-e3ed-41d2-a2c1-3d60ba8e11b2 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:24.920697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526748b-e3ed-41d2-a2c1-3d60ba8e11b2 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:24.920972 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526748b-e3ed-41d2-a2c1-3d60ba8e11b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:24.928954 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526748b-e3ed-41d2-a2c1-3d60ba8e11b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:24.930542 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526748b-e3ed-41d2-a2c1-3d60ba8e11b2 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:24.939804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 743/1468] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:42:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:29.126477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d79566-f2b6-45ce-a3b2-573e20649f72 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:29.127008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d79566-f2b6-45ce-a3b2-573e20649f72 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:29.127008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d79566-f2b6-45ce-a3b2-573e20649f72 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:29.128771 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 726/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 04:42:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:42:29.134446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b1891-bfbf-446d-a541-4397840ee08c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:29.134894 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b1891-bfbf-446d-a541-4397840ee08c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:29.135064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b1891-bfbf-446d-a541-4397840ee08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:29.154383 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-959b1891-bfbf-446d-a541-4397840ee08c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:29.155578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-959b1891-bfbf-446d-a541-4397840ee08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:29.163401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 744/1470] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 04:42:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:29.204731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d79566-f2b6-45ce-a3b2-573e20649f72 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:29.206412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-28d79566-f2b6-45ce-a3b2-573e20649f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:29.260823 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d79566-f2b6-45ce-a3b2-573e20649f72 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:29.264931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf088d-a03d-4968-a0f3-d183aa677577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:29.265566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf088d-a03d-4968-a0f3-d183aa677577 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:29.265843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf088d-a03d-4968-a0f3-d183aa677577 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:29.266114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf088d-a03d-4968-a0f3-d183aa677577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:29.275103 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf088d-a03d-4968-a0f3-d183aa677577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:29.276560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf088d-a03d-4968-a0f3-d183aa677577 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:29.288277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 727/1471] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:42:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:31.473865 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f099-89a3-4b37-8eeb-bfeb71a5201f None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:31.474411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f099-89a3-4b37-8eeb-bfeb71a5201f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:31.474411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f099-89a3-4b37-8eeb-bfeb71a5201f None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:31.476310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 745/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 04:42:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:42:31.482553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909787-1073-4584-abf3-5362f047cb52 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:31.482985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909787-1073-4584-abf3-5362f047cb52 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:31.483114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909787-1073-4584-abf3-5362f047cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:31.501490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-90909787-1073-4584-abf3-5362f047cb52 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:31.502690 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-90909787-1073-4584-abf3-5362f047cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:31.510499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 728/1473] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 04:42:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:31.548073 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8f099-89a3-4b37-8eeb-bfeb71a5201f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:31.549856 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8ef8f099-89a3-4b37-8eeb-bfeb71a5201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:31.563241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8f099-89a3-4b37-8eeb-bfeb71a5201f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:31.566842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2a96e-667f-4234-b5a8-528285e63067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:31.567537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2a96e-667f-4234-b5a8-528285e63067 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:31.567820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2a96e-667f-4234-b5a8-528285e63067 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:31.568098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2a96e-667f-4234-b5a8-528285e63067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:31.577110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2a96e-667f-4234-b5a8-528285e63067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:31.578543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2a96e-667f-4234-b5a8-528285e63067 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:31.588065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 746/1474] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:42:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:35.406607 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6dab5-b91e-4fde-9fd3-b07aab153126 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:35.407172 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6dab5-b91e-4fde-9fd3-b07aab153126 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:35.407271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6dab5-b91e-4fde-9fd3-b07aab153126 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:35.409075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 729/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 04:42:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:42:35.414768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895455-6fcf-4e2e-b36d-d3df6208455a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:35.415188 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895455-6fcf-4e2e-b36d-d3df6208455a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:35.415331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895455-6fcf-4e2e-b36d-d3df6208455a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:35.434113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-aa895455-6fcf-4e2e-b36d-d3df6208455a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:35.435915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-aa895455-6fcf-4e2e-b36d-d3df6208455a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:35.443882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 747/1476] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 04:42:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:35.497146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6dab5-b91e-4fde-9fd3-b07aab153126 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:35.499417 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-34d6dab5-b91e-4fde-9fd3-b07aab153126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:35.555918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6dab5-b91e-4fde-9fd3-b07aab153126 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:35.559494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49199b55-eece-4304-8cfe-3217d9e9b4ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:35.560143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49199b55-eece-4304-8cfe-3217d9e9b4ec service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:35.560452 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49199b55-eece-4304-8cfe-3217d9e9b4ec service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:35.560733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49199b55-eece-4304-8cfe-3217d9e9b4ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:35.569867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49199b55-eece-4304-8cfe-3217d9e9b4ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:35.571304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49199b55-eece-4304-8cfe-3217d9e9b4ec service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:35.582810 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 730/1477] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:42:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:37.734405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56919fa8-5e2a-4a17-83b4-bce2c8c98eb7 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:37.734912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56919fa8-5e2a-4a17-83b4-bce2c8c98eb7 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:37.735005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56919fa8-5e2a-4a17-83b4-bce2c8c98eb7 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:37.736795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 748/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 04:42:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:42:37.742388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90028b3-6fff-4d4c-8de7-b020f55ad595 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:37.742811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90028b3-6fff-4d4c-8de7-b020f55ad595 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:37.742951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90028b3-6fff-4d4c-8de7-b020f55ad595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:37.761255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b90028b3-6fff-4d4c-8de7-b020f55ad595 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:37.762463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b90028b3-6fff-4d4c-8de7-b020f55ad595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:37.771105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 731/1479] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 04:42:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:37.824252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc373a97-56c3-46e2-bec3-74fdb84deb64 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:37.824556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc373a97-56c3-46e2-bec3-74fdb84deb64 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:37.824831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc373a97-56c3-46e2-bec3-74fdb84deb64 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:37.827270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 749/1480] 10.222.0.25 () {54 vars in 966 bytes} [Fri Aug 27 04:42:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:42:37.832581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c62f-d506-458e-9a13-e40dd96f02ba None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:37.832873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c62f-d506-458e-9a13-e40dd96f02ba None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:37.833154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c62f-d506-458e-9a13-e40dd96f02ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:37.850749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7116c62f-d506-458e-9a13-e40dd96f02ba None None] MFA Rules not processed for user `c711b68b32a7435a93b12553972f9f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:37.852081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7116c62f-d506-458e-9a13-e40dd96f02ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:37.858291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 732/1481] 10.222.0.25 () {58 vars in 1064 bytes} [Fri Aug 27 04:42:37 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:37.866296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc373a97-56c3-46e2-bec3-74fdb84deb64 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:37.877313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc373a97-56c3-46e2-bec3-74fdb84deb64 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:37.880895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf78245-fe66-46a2-ba17-db5a909bc220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:37.881523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf78245-fe66-46a2-ba17-db5a909bc220 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:37.881808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf78245-fe66-46a2-ba17-db5a909bc220 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:37.882087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf78245-fe66-46a2-ba17-db5a909bc220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:37.891619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf78245-fe66-46a2-ba17-db5a909bc220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:37.893386 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf78245-fe66-46a2-ba17-db5a909bc220 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:37.902661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 750/1482] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:42:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:00.729579 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b3c94-0ba2-47d6-aeaa-56fbdc975563 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:00.730169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b3c94-0ba2-47d6-aeaa-56fbdc975563 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:00.730169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b3c94-0ba2-47d6-aeaa-56fbdc975563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:00.753984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-f60b3c94-0ba2-47d6-aeaa-56fbdc975563 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:00.755209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f60b3c94-0ba2-47d6-aeaa-56fbdc975563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:00.771757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 733/1483] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:00.781453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3070d81-5768-4cfc-a917-9a727b52f1bb None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:00.781965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3070d81-5768-4cfc-a917-9a727b52f1bb None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:00.782049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3070d81-5768-4cfc-a917-9a727b52f1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:00.785386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85cc75-78b1-4f46-90ff-a65aab5bbf2c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:00.785673 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85cc75-78b1-4f46-90ff-a65aab5bbf2c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:00.786093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85cc75-78b1-4f46-90ff-a65aab5bbf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:00.813631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-c3070d81-5768-4cfc-a917-9a727b52f1bb None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:00.815255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c3070d81-5768-4cfc-a917-9a727b52f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:00.821489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2f85cc75-78b1-4f46-90ff-a65aab5bbf2c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:00.822698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2f85cc75-78b1-4f46-90ff-a65aab5bbf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:00.831686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 751/1484] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:00.835100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 734/1485] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:00.840262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336401-2f21-4d04-9083-be3996e3dc4b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:00.840719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336401-2f21-4d04-9083-be3996e3dc4b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:00.841242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336401-2f21-4d04-9083-be3996e3dc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:00.846865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85cc75-78b1-4f46-90ff-a65aab5bbf2c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:00.863085 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85cc75-78b1-4f46-90ff-a65aab5bbf2c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:00.869166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e8336401-2f21-4d04-9083-be3996e3dc4b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:00.870563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e8336401-2f21-4d04-9083-be3996e3dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:00.875994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b04b09-1eb5-4c9a-a7f9-f9ff765074f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:00.877036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b04b09-1eb5-4c9a-a7f9-f9ff765074f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:00.877569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b04b09-1eb5-4c9a-a7f9-f9ff765074f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:00.878061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b04b09-1eb5-4c9a-a7f9-f9ff765074f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:00.879399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b04b09-1eb5-4c9a-a7f9-f9ff765074f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:00.879936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b04b09-1eb5-4c9a-a7f9-f9ff765074f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:00.881967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b04b09-1eb5-4c9a-a7f9-f9ff765074f8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:00.887649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 752/1486] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:00.893034 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8336401-2f21-4d04-9083-be3996e3dc4b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:00.903510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8336401-2f21-4d04-9083-be3996e3dc4b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:00.905605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 735/1487] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:44:00.913376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b04b09-1eb5-4c9a-a7f9-f9ff765074f8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:00.922105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fabf9e-1dbd-4758-af1d-3befa31a99ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:00.923366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fabf9e-1dbd-4758-af1d-3befa31a99ba admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:00.923659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fabf9e-1dbd-4758-af1d-3befa31a99ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:00.923942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fabf9e-1dbd-4758-af1d-3befa31a99ba admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:00.924728 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fabf9e-1dbd-4758-af1d-3befa31a99ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:00.925043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fabf9e-1dbd-4758-af1d-3befa31a99ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:00.926711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fabf9e-1dbd-4758-af1d-3befa31a99ba admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:00.934962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b04b09-1eb5-4c9a-a7f9-f9ff765074f8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:00.940088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 753/1488] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:44:00.947668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe152-0912-4224-a262-dc9111cdfdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:00.948089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fabf9e-1dbd-4758-af1d-3befa31a99ba admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:00.948950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe152-0912-4224-a262-dc9111cdfdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:00.949484 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe152-0912-4224-a262-dc9111cdfdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:00.950001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe152-0912-4224-a262-dc9111cdfdd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:00.950925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fe152-0912-4224-a262-dc9111cdfdd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:00.953860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fe152-0912-4224-a262-dc9111cdfdd4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:00.959788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fabf9e-1dbd-4758-af1d-3befa31a99ba admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:00.980611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5b269-af4b-42eb-9bbb-b69a61ba3226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:00.981292 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b269-af4b-42eb-9bbb-b69a61ba3226 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:00.981582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b269-af4b-42eb-9bbb-b69a61ba3226 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:00.981865 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b269-af4b-42eb-9bbb-b69a61ba3226 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:00.983097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5b269-af4b-42eb-9bbb-b69a61ba3226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:00.985100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5b269-af4b-42eb-9bbb-b69a61ba3226 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.069122 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 736/1489] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:00 2021] POST /identity/v3/projects => generated 405 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:01.070952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728c845-9785-4d06-bea8-ec8ddaa3af7d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.071460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728c845-9785-4d06-bea8-ec8ddaa3af7d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.072085 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728c845-9785-4d06-bea8-ec8ddaa3af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.091846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b728c845-9785-4d06-bea8-ec8ddaa3af7d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.093985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b728c845-9785-4d06-bea8-ec8ddaa3af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.096749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 754/1490] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:00 2021] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:01.100565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f661b55-125b-4745-b6ba-ce602fe2f5a5 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.100885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f661b55-125b-4745-b6ba-ce602fe2f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.101169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f661b55-125b-4745-b6ba-ce602fe2f5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.123558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-8f661b55-125b-4745-b6ba-ce602fe2f5a5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.124925 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8f661b55-125b-4745-b6ba-ce602fe2f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.171903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 737/1491] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.173410 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d26aa-dffd-4e84-ad7f-c129db396daa None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.173706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d26aa-dffd-4e84-ad7f-c129db396daa None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.173984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d26aa-dffd-4e84-ad7f-c129db396daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.192318 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2d3d26aa-dffd-4e84-ad7f-c129db396daa None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.193580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2d3d26aa-dffd-4e84-ad7f-c129db396daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.200068 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 755/1492] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.208478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f661b55-125b-4745-b6ba-ce602fe2f5a5 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.208643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 738/1493] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.208643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f823d4-ca8e-4fc4-a782-9fa55d7eb49b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.208643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f823d4-ca8e-4fc4-a782-9fa55d7eb49b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.208643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f823d4-ca8e-4fc4-a782-9fa55d7eb49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.211222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f661b55-125b-4745-b6ba-ce602fe2f5a5 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.215777 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e6af9-2357-4414-9dfc-0b3508b2f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.216476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e6af9-2357-4414-9dfc-0b3508b2f1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.216783 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e6af9-2357-4414-9dfc-0b3508b2f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.217060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e6af9-2357-4414-9dfc-0b3508b2f1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.217913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e6af9-2357-4414-9dfc-0b3508b2f1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.219833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e6af9-2357-4414-9dfc-0b3508b2f1a8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.226706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b4f823d4-ca8e-4fc4-a782-9fa55d7eb49b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.228489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b4f823d4-ca8e-4fc4-a782-9fa55d7eb49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.239152 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 739/1494] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.240578 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f823d4-ca8e-4fc4-a782-9fa55d7eb49b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.251831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f823d4-ca8e-4fc4-a782-9fa55d7eb49b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.256414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198de567-474d-42c4-8b1f-223985a8c2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.257066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198de567-474d-42c4-8b1f-223985a8c2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.257353 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198de567-474d-42c4-8b1f-223985a8c2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.257657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198de567-474d-42c4-8b1f-223985a8c2b5 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.258319 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198de567-474d-42c4-8b1f-223985a8c2b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.260242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198de567-474d-42c4-8b1f-223985a8c2b5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.301227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 756/1495] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:01.302665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a90be-e5c5-4ed2-98e2-85a6f0b7e5f9 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.302955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a90be-e5c5-4ed2-98e2-85a6f0b7e5f9 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.303231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a90be-e5c5-4ed2-98e2-85a6f0b7e5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.321058 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-514a90be-e5c5-4ed2-98e2-85a6f0b7e5f9 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.322249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-514a90be-e5c5-4ed2-98e2-85a6f0b7e5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.329986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 757/1496] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.332776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de0477-aad9-45a7-913e-c02559aaefcd None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.332776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de0477-aad9-45a7-913e-c02559aaefcd None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.332776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de0477-aad9-45a7-913e-c02559aaefcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.349179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f9de0477-aad9-45a7-913e-c02559aaefcd None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.350343 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f9de0477-aad9-45a7-913e-c02559aaefcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.361345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 740/1497] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:01.361533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 758/1498] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.361631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e742f9-e5ef-4c75-910a-b2af26e58ae5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.361729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db5796-ce31-4889-91b8-36d7d19e93c8 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.361819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e742f9-e5ef-4c75-910a-b2af26e58ae5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.361900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db5796-ce31-4889-91b8-36d7d19e93c8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.361983 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e742f9-e5ef-4c75-910a-b2af26e58ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.362065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db5796-ce31-4889-91b8-36d7d19e93c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.378787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-03db5796-ce31-4889-91b8-36d7d19e93c8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.379842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c0e742f9-e5ef-4c75-910a-b2af26e58ae5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.380028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-03db5796-ce31-4889-91b8-36d7d19e93c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.381068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c0e742f9-e5ef-4c75-910a-b2af26e58ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.387686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 759/1499] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.389138 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 741/1500] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.389271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118eb486-f92f-4b43-9f8a-a78eb9a0c7df None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.389371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118eb486-f92f-4b43-9f8a-a78eb9a0c7df None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.389631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118eb486-f92f-4b43-9f8a-a78eb9a0c7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.390308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972bd3b-e1d4-4d67-8f7d-7b0073972889 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.390599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972bd3b-e1d4-4d67-8f7d-7b0073972889 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.390893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972bd3b-e1d4-4d67-8f7d-7b0073972889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.409234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-f972bd3b-e1d4-4d67-8f7d-7b0073972889 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.410334 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f972bd3b-e1d4-4d67-8f7d-7b0073972889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.411458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-118eb486-f92f-4b43-9f8a-a78eb9a0c7df None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.412627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-118eb486-f92f-4b43-9f8a-a78eb9a0c7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.418115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 742/1501] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.418892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972bd3b-e1d4-4d67-8f7d-7b0073972889 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.421653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 760/1502] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.422973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34ef2-1798-488d-9b56-a36eb76f1670 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.423504 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34ef2-1798-488d-9b56-a36eb76f1670 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.423854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34ef2-1798-488d-9b56-a36eb76f1670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.429178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972bd3b-e1d4-4d67-8f7d-7b0073972889 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.433879 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d6d56-ee2c-406c-a6e3-f2788113839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.434534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d6d56-ee2c-406c-a6e3-f2788113839e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.434821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d6d56-ee2c-406c-a6e3-f2788113839e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.435098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d6d56-ee2c-406c-a6e3-f2788113839e admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.435830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d6d56-ee2c-406c-a6e3-f2788113839e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.437469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d6d56-ee2c-406c-a6e3-f2788113839e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.441275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-1bf34ef2-1798-488d-9b56-a36eb76f1670 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.442447 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1bf34ef2-1798-488d-9b56-a36eb76f1670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.447221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 743/1503] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:01.448173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d6d56-ee2c-406c-a6e3-f2788113839e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.450168 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 761/1504] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.451364 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63073-7351-413e-9419-2c341d53b271 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.451646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63073-7351-413e-9419-2c341d53b271 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.451922 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63073-7351-413e-9419-2c341d53b271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.458869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d6d56-ee2c-406c-a6e3-f2788113839e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.463469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c5ef6-2bdc-4fc0-9aac-6eaf7e2c8461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.464120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5ef6-2bdc-4fc0-9aac-6eaf7e2c8461 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.464433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5ef6-2bdc-4fc0-9aac-6eaf7e2c8461 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.464714 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5ef6-2bdc-4fc0-9aac-6eaf7e2c8461 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.465445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c5ef6-2bdc-4fc0-9aac-6eaf7e2c8461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.467535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c5ef6-2bdc-4fc0-9aac-6eaf7e2c8461 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.470300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-0bf63073-7351-413e-9419-2c341d53b271 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.471467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0bf63073-7351-413e-9419-2c341d53b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.477487 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 744/1505] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:01.484055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 762/1506] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.484055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf63073-7351-413e-9419-2c341d53b271 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.484380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c5ef6-2bdc-4fc0-9aac-6eaf7e2c8461 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.490609 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf63073-7351-413e-9419-2c341d53b271 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.491684 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c5ef6-2bdc-4fc0-9aac-6eaf7e2c8461 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.495349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420eeaca-48f8-435b-ac54-32733dcc6554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.495988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eeaca-48f8-435b-ac54-32733dcc6554 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.496268 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eeaca-48f8-435b-ac54-32733dcc6554 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.496462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a6000-483e-46a2-bd4f-d37e33ae87a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.496628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eeaca-48f8-435b-ac54-32733dcc6554 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.497106 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a6000-483e-46a2-bd4f-d37e33ae87a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.497270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eeaca-48f8-435b-ac54-32733dcc6554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:01.497383 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a6000-483e-46a2-bd4f-d37e33ae87a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.497573 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eeaca-48f8-435b-ac54-32733dcc6554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.497686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a6000-483e-46a2-bd4f-d37e33ae87a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.498357 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a6000-483e-46a2-bd4f-d37e33ae87a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:01.498661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a6000-483e-46a2-bd4f-d37e33ae87a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.499722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eeaca-48f8-435b-ac54-32733dcc6554 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.500246 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a6000-483e-46a2-bd4f-d37e33ae87a8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.512510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 745/1507] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:01.513331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a6000-483e-46a2-bd4f-d37e33ae87a8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.516896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 763/1508] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:01.521367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420eeaca-48f8-435b-ac54-32733dcc6554 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.531260 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a6000-483e-46a2-bd4f-d37e33ae87a8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.531603 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420eeaca-48f8-435b-ac54-32733dcc6554 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.536593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6090bb-ff25-42d6-a138-506604ec8226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.538961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6090bb-ff25-42d6-a138-506604ec8226 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.538961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6090bb-ff25-42d6-a138-506604ec8226 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.538961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6090bb-ff25-42d6-a138-506604ec8226 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.539423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b103a0-ba00-4483-9ae0-687fe22d3c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.539423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b103a0-ba00-4483-9ae0-687fe22d3c92 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.539773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6090bb-ff25-42d6-a138-506604ec8226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:01.539935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b103a0-ba00-4483-9ae0-687fe22d3c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.540087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6090bb-ff25-42d6-a138-506604ec8226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.540233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b103a0-ba00-4483-9ae0-687fe22d3c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.540233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b103a0-ba00-4483-9ae0-687fe22d3c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:01.540233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b103a0-ba00-4483-9ae0-687fe22d3c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.540826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6090bb-ff25-42d6-a138-506604ec8226 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.541783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b103a0-ba00-4483-9ae0-687fe22d3c92 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.554956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 764/1509] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:01.555187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 746/1510] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:01.563028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6090bb-ff25-42d6-a138-506604ec8226 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.563211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b103a0-ba00-4483-9ae0-687fe22d3c92 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.569619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b103a0-ba00-4483-9ae0-687fe22d3c92 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.572006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6090bb-ff25-42d6-a138-506604ec8226 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.574294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74983922-4591-45ad-a5bd-63f12e8eecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.584799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74983922-4591-45ad-a5bd-63f12e8eecd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.584799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74983922-4591-45ad-a5bd-63f12e8eecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.584799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74983922-4591-45ad-a5bd-63f12e8eecd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.584799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74983922-4591-45ad-a5bd-63f12e8eecd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:01.584799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74983922-4591-45ad-a5bd-63f12e8eecd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.585235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96bed7-94e2-4fb2-ac7b-5321482fb015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.585235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96bed7-94e2-4fb2-ac7b-5321482fb015 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.585424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74983922-4591-45ad-a5bd-63f12e8eecd7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.585510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96bed7-94e2-4fb2-ac7b-5321482fb015 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.585510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96bed7-94e2-4fb2-ac7b-5321482fb015 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.585510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96bed7-94e2-4fb2-ac7b-5321482fb015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.585510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96bed7-94e2-4fb2-ac7b-5321482fb015 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.590906 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 747/1511] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:01.591396 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 765/1512] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:01 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:01.593087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96bed7-94e2-4fb2-ac7b-5321482fb015 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.594259 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74983922-4591-45ad-a5bd-63f12e8eecd7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.604271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74983922-4591-45ad-a5bd-63f12e8eecd7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.604544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96bed7-94e2-4fb2-ac7b-5321482fb015 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.611258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e4e3-0aab-4baa-a9aa-f96843bea529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.611428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2c0f3-4f58-4c9c-b8e9-bc6361115496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.611919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e4e3-0aab-4baa-a9aa-f96843bea529 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.612027 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c0f3-4f58-4c9c-b8e9-bc6361115496 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.612207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e4e3-0aab-4baa-a9aa-f96843bea529 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.612380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c0f3-4f58-4c9c-b8e9-bc6361115496 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.612498 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e4e3-0aab-4baa-a9aa-f96843bea529 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.612632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c0f3-4f58-4c9c-b8e9-bc6361115496 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.613227 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6e4e3-0aab-4baa-a9aa-f96843bea529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.613344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2c0f3-4f58-4c9c-b8e9-bc6361115496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:01.613693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2c0f3-4f58-4c9c-b8e9-bc6361115496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.614850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6e4e3-0aab-4baa-a9aa-f96843bea529 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.615274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2c0f3-4f58-4c9c-b8e9-bc6361115496 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.625234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 748/1513] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:01 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:01.626122 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e4e3-0aab-4baa-a9aa-f96843bea529 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.628026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 766/1514] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:01.629082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2c0f3-4f58-4c9c-b8e9-bc6361115496 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.637712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e4e3-0aab-4baa-a9aa-f96843bea529 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.638330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2c0f3-4f58-4c9c-b8e9-bc6361115496 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.642721 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02574a5-40fa-485c-914e-b7c058b58344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.643085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29de1-bc2e-4cc3-8536-85cf54cc840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.643366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02574a5-40fa-485c-914e-b7c058b58344 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.643651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02574a5-40fa-485c-914e-b7c058b58344 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.643768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29de1-bc2e-4cc3-8536-85cf54cc840c admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.643956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02574a5-40fa-485c-914e-b7c058b58344 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.644100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29de1-bc2e-4cc3-8536-85cf54cc840c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.644393 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29de1-bc2e-4cc3-8536-85cf54cc840c admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.644681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02574a5-40fa-485c-914e-b7c058b58344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.645094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c29de1-bc2e-4cc3-8536-85cf54cc840c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.646594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02574a5-40fa-485c-914e-b7c058b58344 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.646993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c29de1-bc2e-4cc3-8536-85cf54cc840c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.736458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 767/1515] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:01.737353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29de1-bc2e-4cc3-8536-85cf54cc840c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.766571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 749/1516] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:01.766571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02574a5-40fa-485c-914e-b7c058b58344 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.797818 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29de1-bc2e-4cc3-8536-85cf54cc840c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.825662 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02574a5-40fa-485c-914e-b7c058b58344 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.830840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a4d3f-f10b-4a6f-b462-39a63ed14de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.831502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4d3f-f10b-4a6f-b462-39a63ed14de6 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.831788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4d3f-f10b-4a6f-b462-39a63ed14de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.832067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4d3f-f10b-4a6f-b462-39a63ed14de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.832789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a4d3f-f10b-4a6f-b462-39a63ed14de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.834715 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a4d3f-f10b-4a6f-b462-39a63ed14de6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.850562 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52ddb8-d9ca-4df5-8a6a-37cfe07ff015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.851224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52ddb8-d9ca-4df5-8a6a-37cfe07ff015 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.851505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52ddb8-d9ca-4df5-8a6a-37cfe07ff015 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.851775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52ddb8-d9ca-4df5-8a6a-37cfe07ff015 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.852480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52ddb8-d9ca-4df5-8a6a-37cfe07ff015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.854364 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52ddb8-d9ca-4df5-8a6a-37cfe07ff015 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.939163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 750/1517] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:01.940075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a4d3f-f10b-4a6f-b462-39a63ed14de6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.969143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 768/1518] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/projects => generated 391 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:01.970178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52ddb8-d9ca-4df5-8a6a-37cfe07ff015 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.004462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a4d3f-f10b-4a6f-b462-39a63ed14de6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.035074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52ddb8-d9ca-4df5-8a6a-37cfe07ff015 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.039819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc6e5-8852-43d3-983c-7dba9dadcfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.040639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc6e5-8852-43d3-983c-7dba9dadcfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.040927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc6e5-8852-43d3-983c-7dba9dadcfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.041201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc6e5-8852-43d3-983c-7dba9dadcfe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.041890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdc6e5-8852-43d3-983c-7dba9dadcfe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.043804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdc6e5-8852-43d3-983c-7dba9dadcfe7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.061119 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadec1e8-7001-486e-bc85-ff97e069afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.062013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadec1e8-7001-486e-bc85-ff97e069afd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.062299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadec1e8-7001-486e-bc85-ff97e069afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.062618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadec1e8-7001-486e-bc85-ff97e069afd1 admin admin] PATH_INFO: `/v3/projects/69be034484ab4476a6a5647dda070eff/users/f0a68d844864490f97d5f8737519afd6/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.078042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadec1e8-7001-486e-bc85-ff97e069afd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69be034484ab4476a6a5647dda070eff, user_id=f0a68d844864490f97d5f8737519afd6, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.080903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadec1e8-7001-486e-bc85-ff97e069afd1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.189737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 769/1519] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:01 2021] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:02.189737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc6e5-8852-43d3-983c-7dba9dadcfe7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.197779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 751/1520] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:01 2021] PUT /identity/v3/projects/69be034484ab4476a6a5647dda070eff/users/f0a68d844864490f97d5f8737519afd6/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:02.198636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadec1e8-7001-486e-bc85-ff97e069afd1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.246832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc6e5-8852-43d3-983c-7dba9dadcfe7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.257028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadec1e8-7001-486e-bc85-ff97e069afd1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.261736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e4ac7-a020-483b-8b77-6568e6e40632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.262389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4ac7-a020-483b-8b77-6568e6e40632 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.262671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4ac7-a020-483b-8b77-6568e6e40632 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.262943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4ac7-a020-483b-8b77-6568e6e40632 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.264301 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e4ac7-a020-483b-8b77-6568e6e40632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.266496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e4ac7-a020-483b-8b77-6568e6e40632 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.300689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f1576-7eb5-4d64-ba84-ad73da3e3a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.301571 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f1576-7eb5-4d64-ba84-ad73da3e3a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.301848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f1576-7eb5-4d64-ba84-ad73da3e3a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.302145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f1576-7eb5-4d64-ba84-ad73da3e3a4e admin admin] PATH_INFO: `/v3/projects/3d4cde4815bf4ba0b7081d5f92ff5b43/users/01e9ef5adcdd41a586007c929e2a3970/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.315906 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f1576-7eb5-4d64-ba84-ad73da3e3a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4cde4815bf4ba0b7081d5f92ff5b43, user_id=01e9ef5adcdd41a586007c929e2a3970, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.318616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f1576-7eb5-4d64-ba84-ad73da3e3a4e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.347362 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 752/1521] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:02 2021] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:02.352249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e4ac7-a020-483b-8b77-6568e6e40632 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.403726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 770/1522] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:02 2021] PUT /identity/v3/projects/3d4cde4815bf4ba0b7081d5f92ff5b43/users/01e9ef5adcdd41a586007c929e2a3970/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:02.404661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f1576-7eb5-4d64-ba84-ad73da3e3a4e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.406352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e4ac7-a020-483b-8b77-6568e6e40632 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.460283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b042e3-32bf-4205-94b3-7afb413e1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.460988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b042e3-32bf-4205-94b3-7afb413e1c0a admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.461269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b042e3-32bf-4205-94b3-7afb413e1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.461545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b042e3-32bf-4205-94b3-7afb413e1c0a admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.462234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b042e3-32bf-4205-94b3-7afb413e1c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.464166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b042e3-32bf-4205-94b3-7afb413e1c0a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.464683 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f1576-7eb5-4d64-ba84-ad73da3e3a4e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.469348 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0082-f8c7-4857-8084-f5d729e64ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.470004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0082-f8c7-4857-8084-f5d729e64ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.470281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0082-f8c7-4857-8084-f5d729e64ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.470551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0082-f8c7-4857-8084-f5d729e64ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.471224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd0082-f8c7-4857-8084-f5d729e64ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.473162 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd0082-f8c7-4857-8084-f5d729e64ab1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.575778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 753/1523] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:02 2021] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:02.576585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b042e3-32bf-4205-94b3-7afb413e1c0a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.586931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b042e3-32bf-4205-94b3-7afb413e1c0a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.590622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 771/1524] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:02 2021] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:02.590622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0082-f8c7-4857-8084-f5d729e64ab1 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.594733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481336d-cec8-41ab-93d2-28ca3e2d342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.595404 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481336d-cec8-41ab-93d2-28ca3e2d342e admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.595687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481336d-cec8-41ab-93d2-28ca3e2d342e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.595962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481336d-cec8-41ab-93d2-28ca3e2d342e admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.596699 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481336d-cec8-41ab-93d2-28ca3e2d342e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.598643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481336d-cec8-41ab-93d2-28ca3e2d342e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.600213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0082-f8c7-4857-8084-f5d729e64ab1 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.604969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d92a0-1730-4a77-9979-71bc1e1625ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.605661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d92a0-1730-4a77-9979-71bc1e1625ea admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.610395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d92a0-1730-4a77-9979-71bc1e1625ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.610395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d92a0-1730-4a77-9979-71bc1e1625ea admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.610395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d92a0-1730-4a77-9979-71bc1e1625ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.610395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d92a0-1730-4a77-9979-71bc1e1625ea admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.693965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 754/1525] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:02 2021] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:02.694930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481336d-cec8-41ab-93d2-28ca3e2d342e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.705114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481336d-cec8-41ab-93d2-28ca3e2d342e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.709765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2c228-5d41-46b1-b503-ca16a68699e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.710415 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c228-5d41-46b1-b503-ca16a68699e8 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.710693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c228-5d41-46b1-b503-ca16a68699e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.710963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c228-5d41-46b1-b503-ca16a68699e8 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.711641 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2c228-5d41-46b1-b503-ca16a68699e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.713632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2c228-5d41-46b1-b503-ca16a68699e8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.728060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 772/1526] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:02 2021] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:02.729477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58df73a-bd8d-470e-a28f-dcf718cdc0be None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.729764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58df73a-bd8d-470e-a28f-dcf718cdc0be None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.730050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58df73a-bd8d-470e-a28f-dcf718cdc0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.756330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f58df73a-bd8d-470e-a28f-dcf718cdc0be None None] MFA Rules not processed for user `f0a68d844864490f97d5f8737519afd6`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:02.757666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f58df73a-bd8d-470e-a28f-dcf718cdc0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:02.810407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 755/1527] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:02 2021] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:02.812289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2c228-5d41-46b1-b503-ca16a68699e8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.828053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 773/1528] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:02 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:02.828630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2c228-5d41-46b1-b503-ca16a68699e8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.828734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56910e-b083-4628-b32d-c8722a013fae None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.828734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56910e-b083-4628-b32d-c8722a013fae None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.828734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56910e-b083-4628-b32d-c8722a013fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.832288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc7378-dd60-49aa-a912-a120f6c30ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.832993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc7378-dd60-49aa-a912-a120f6c30ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.833270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc7378-dd60-49aa-a912-a120f6c30ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.833542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc7378-dd60-49aa-a912-a120f6c30ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.834253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc7378-dd60-49aa-a912-a120f6c30ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.836217 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc7378-dd60-49aa-a912-a120f6c30ee3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.855484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ba56910e-b083-4628-b32d-c8722a013fae None None] MFA Rules not processed for user `01e9ef5adcdd41a586007c929e2a3970`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:02.856745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ba56910e-b083-4628-b32d-c8722a013fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:02.928644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 774/1529] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:02 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:02.929597 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56910e-b083-4628-b32d-c8722a013fae None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.941211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 756/1530] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:02 2021] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:02.941211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc7378-dd60-49aa-a912-a120f6c30ee3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.943614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56910e-b083-4628-b32d-c8722a013fae None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.947560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234781e-03d2-4cd7-a341-1fb8117145bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.948478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234781e-03d2-4cd7-a341-1fb8117145bc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.948762 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234781e-03d2-4cd7-a341-1fb8117145bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.949035 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234781e-03d2-4cd7-a341-1fb8117145bc admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.949796 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234781e-03d2-4cd7-a341-1fb8117145bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.950763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc7378-dd60-49aa-a912-a120f6c30ee3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.951416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234781e-03d2-4cd7-a341-1fb8117145bc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.955579 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc5608-37d9-408c-9d31-a2f58aece21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.956277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc5608-37d9-408c-9d31-a2f58aece21a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.956591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc5608-37d9-408c-9d31-a2f58aece21a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.956869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc5608-37d9-408c-9d31-a2f58aece21a admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.957600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc5608-37d9-408c-9d31-a2f58aece21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.959233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc5608-37d9-408c-9d31-a2f58aece21a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.965959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 775/1531] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:02 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:02.965959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234781e-03d2-4cd7-a341-1fb8117145bc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.970433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 757/1532] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:02.972009 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc5608-37d9-408c-9d31-a2f58aece21a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.976410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234781e-03d2-4cd7-a341-1fb8117145bc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.981330 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc5608-37d9-408c-9d31-a2f58aece21a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.981705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4131d6-9e4b-455c-879b-d005f43cc38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.982473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4131d6-9e4b-455c-879b-d005f43cc38e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.983350 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4131d6-9e4b-455c-879b-d005f43cc38e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.983647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4131d6-9e4b-455c-879b-d005f43cc38e admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.984423 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4131d6-9e4b-455c-879b-d005f43cc38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.986025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4131d6-9e4b-455c-879b-d005f43cc38e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.986532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3fe50-55bf-4440-a80e-e0a0a8b416f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.987210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3fe50-55bf-4440-a80e-e0a0a8b416f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.987474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3fe50-55bf-4440-a80e-e0a0a8b416f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.987781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3fe50-55bf-4440-a80e-e0a0a8b416f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.988544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3fe50-55bf-4440-a80e-e0a0a8b416f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.990167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3fe50-55bf-4440-a80e-e0a0a8b416f2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.005542 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 776/1533] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:02 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:03.005542 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4131d6-9e4b-455c-879b-d005f43cc38e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.005853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 758/1534] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:03.005853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3fe50-55bf-4440-a80e-e0a0a8b416f2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.010538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3fe50-55bf-4440-a80e-e0a0a8b416f2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.015112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4131d6-9e4b-455c-879b-d005f43cc38e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.015766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8690c-a1c0-4eda-a6b7-ab503dfe742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.016792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8690c-a1c0-4eda-a6b7-ab503dfe742c admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.017079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8690c-a1c0-4eda-a6b7-ab503dfe742c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.017366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8690c-a1c0-4eda-a6b7-ab503dfe742c admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.018066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8690c-a1c0-4eda-a6b7-ab503dfe742c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.020186 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8690c-a1c0-4eda-a6b7-ab503dfe742c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.020302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a1521-3042-4cba-a49d-c27e473ca6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.020928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1521-3042-4cba-a49d-c27e473ca6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.021220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1521-3042-4cba-a49d-c27e473ca6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.021491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1521-3042-4cba-a49d-c27e473ca6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.022203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a1521-3042-4cba-a49d-c27e473ca6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.023787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a1521-3042-4cba-a49d-c27e473ca6b6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.035230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 777/1535] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:03.035895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a1521-3042-4cba-a49d-c27e473ca6b6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.091475 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a1521-3042-4cba-a49d-c27e473ca6b6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.095589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e7762-166c-4dfc-ac9d-09335795d0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.096235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e7762-166c-4dfc-ac9d-09335795d0bc service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.096551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e7762-166c-4dfc-ac9d-09335795d0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.096831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e7762-166c-4dfc-ac9d-09335795d0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.105545 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e7762-166c-4dfc-ac9d-09335795d0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.107165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e7762-166c-4dfc-ac9d-09335795d0bc service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.109045 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 759/1536] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:03 2021] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:03.109900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8690c-a1c0-4eda-a6b7-ab503dfe742c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.117952 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 778/1537] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:03 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:03.118908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e7762-166c-4dfc-ac9d-09335795d0bc service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.129245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e7762-166c-4dfc-ac9d-09335795d0bc service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.177896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8690c-a1c0-4eda-a6b7-ab503dfe742c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.183856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e004b6-ef3a-4b84-94d5-ca376cc69a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.184706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e004b6-ef3a-4b84-94d5-ca376cc69a7e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.184960 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e004b6-ef3a-4b84-94d5-ca376cc69a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.185238 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e004b6-ef3a-4b84-94d5-ca376cc69a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.186214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e004b6-ef3a-4b84-94d5-ca376cc69a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.187874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e004b6-ef3a-4b84-94d5-ca376cc69a7e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.199782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 760/1538] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:03 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:03.200596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e004b6-ef3a-4b84-94d5-ca376cc69a7e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.204204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce34941-61e2-4b30-b07d-7f4b51357638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.206373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34941-61e2-4b30-b07d-7f4b51357638 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.206373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34941-61e2-4b30-b07d-7f4b51357638 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.206373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34941-61e2-4b30-b07d-7f4b51357638 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.206373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce34941-61e2-4b30-b07d-7f4b51357638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.207987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce34941-61e2-4b30-b07d-7f4b51357638 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.212268 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e004b6-ef3a-4b84-94d5-ca376cc69a7e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.218082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd53f-49da-46e0-bb32-563c3f51fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.218844 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd53f-49da-46e0-bb32-563c3f51fe6f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.219204 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd53f-49da-46e0-bb32-563c3f51fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.219553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd53f-49da-46e0-bb32-563c3f51fe6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.220392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbd53f-49da-46e0-bb32-563c3f51fe6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.220515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 779/1539] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:03 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:03.226205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce34941-61e2-4b30-b07d-7f4b51357638 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.226457 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbd53f-49da-46e0-bb32-563c3f51fe6f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.236189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce34941-61e2-4b30-b07d-7f4b51357638 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.236432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 761/1540] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:03.237137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd53f-49da-46e0-bb32-563c3f51fe6f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.244831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ae364-2734-4a40-8aa5-b2b5989b1b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.245511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ae364-2734-4a40-8aa5-b2b5989b1b49 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.245798 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ae364-2734-4a40-8aa5-b2b5989b1b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.246067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ae364-2734-4a40-8aa5-b2b5989b1b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.246795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ae364-2734-4a40-8aa5-b2b5989b1b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.248598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ae364-2734-4a40-8aa5-b2b5989b1b49 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.249656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd53f-49da-46e0-bb32-563c3f51fe6f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.255886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29327816-f9a9-4f3f-b56d-1a9cc6c70633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.256571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327816-f9a9-4f3f-b56d-1a9cc6c70633 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.256952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327816-f9a9-4f3f-b56d-1a9cc6c70633 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.257323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327816-f9a9-4f3f-b56d-1a9cc6c70633 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.258010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29327816-f9a9-4f3f-b56d-1a9cc6c70633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.259769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29327816-f9a9-4f3f-b56d-1a9cc6c70633 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.261502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 780/1541] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:03 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:03.262230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ae364-2734-4a40-8aa5-b2b5989b1b49 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.275604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 762/1542] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:03 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:03.276380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29327816-f9a9-4f3f-b56d-1a9cc6c70633 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.278870 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ae364-2734-4a40-8aa5-b2b5989b1b49 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.285319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b88e79-0b43-47ae-8565-59ef59a2765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.286065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b88e79-0b43-47ae-8565-59ef59a2765b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.286357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b88e79-0b43-47ae-8565-59ef59a2765b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.286637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b88e79-0b43-47ae-8565-59ef59a2765b admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.287439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b88e79-0b43-47ae-8565-59ef59a2765b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.289249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b88e79-0b43-47ae-8565-59ef59a2765b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.290308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29327816-f9a9-4f3f-b56d-1a9cc6c70633 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.296831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6741c4-10cc-4dde-895d-1d29826744c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.297832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6741c4-10cc-4dde-895d-1d29826744c5 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.298310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6741c4-10cc-4dde-895d-1d29826744c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.298725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6741c4-10cc-4dde-895d-1d29826744c5 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.299855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6741c4-10cc-4dde-895d-1d29826744c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.301129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 781/1543] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:03 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:03.302311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b88e79-0b43-47ae-8565-59ef59a2765b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.303340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6741c4-10cc-4dde-895d-1d29826744c5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.318335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b88e79-0b43-47ae-8565-59ef59a2765b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.323305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2815f-027c-40f6-b59f-c966ef15e5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.324146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2815f-027c-40f6-b59f-c966ef15e5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.324294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2815f-027c-40f6-b59f-c966ef15e5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.330855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2815f-027c-40f6-b59f-c966ef15e5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.330855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2815f-027c-40f6-b59f-c966ef15e5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.330855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2815f-027c-40f6-b59f-c966ef15e5e0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.338840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 782/1544] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:03 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:03.339728 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2815f-027c-40f6-b59f-c966ef15e5e0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.350902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2815f-027c-40f6-b59f-c966ef15e5e0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.355948 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c867a8e-c895-4bc1-b43c-facf3ab4c2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.357061 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c867a8e-c895-4bc1-b43c-facf3ab4c2ad admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.357639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c867a8e-c895-4bc1-b43c-facf3ab4c2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.357639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c867a8e-c895-4bc1-b43c-facf3ab4c2ad admin admin] PATH_INFO: `/v3/projects/6ca6f1d385e747fda6bcfb72620f85f3/users/6e3d01958d7647bc86f2d555c4e1a6dd/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.373583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c867a8e-c895-4bc1-b43c-facf3ab4c2ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca6f1d385e747fda6bcfb72620f85f3, user_id=6e3d01958d7647bc86f2d555c4e1a6dd, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.376298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c867a8e-c895-4bc1-b43c-facf3ab4c2ad admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.430166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 763/1545] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:03 2021] POST /identity/v3/users => generated 308 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:03.431230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6741c4-10cc-4dde-895d-1d29826744c5 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.440549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6741c4-10cc-4dde-895d-1d29826744c5 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.445097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f06d4d-7b72-4a11-976a-385950f4cb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.446005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f06d4d-7b72-4a11-976a-385950f4cb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.446281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f06d4d-7b72-4a11-976a-385950f4cb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.446547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f06d4d-7b72-4a11-976a-385950f4cb68 admin admin] PATH_INFO: `/v3/projects/92c62b314d6847ee9e2914da673983f8/users/2b4505705320486aa4df292ee7c0041e/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.460903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f06d4d-7b72-4a11-976a-385950f4cb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c62b314d6847ee9e2914da673983f8, user_id=2b4505705320486aa4df292ee7c0041e, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.463576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f06d4d-7b72-4a11-976a-385950f4cb68 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.509595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 783/1546] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:03 2021] PUT /identity/v3/projects/6ca6f1d385e747fda6bcfb72620f85f3/users/6e3d01958d7647bc86f2d555c4e1a6dd/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:03.510522 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c867a8e-c895-4bc1-b43c-facf3ab4c2ad admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.570790 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 764/1547] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:03 2021] PUT /identity/v3/projects/92c62b314d6847ee9e2914da673983f8/users/2b4505705320486aa4df292ee7c0041e/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:03.571050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c867a8e-c895-4bc1-b43c-facf3ab4c2ad admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.571767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f06d4d-7b72-4a11-976a-385950f4cb68 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.631085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798e1f2-9092-49bb-abb0-507528bbaf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.632031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798e1f2-9092-49bb-abb0-507528bbaf3e admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.632317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798e1f2-9092-49bb-abb0-507528bbaf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.632626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798e1f2-9092-49bb-abb0-507528bbaf3e admin admin] PATH_INFO: `/v3/projects/bab1a23d8ead4f71956c5e90bbe29587/users/d21dce70b6444f0a9c129ae8bc6fdb38/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.637110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f06d4d-7b72-4a11-976a-385950f4cb68 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.643967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dd16e-141a-4cc8-b8a7-bb8b06615d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.643967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dd16e-141a-4cc8-b8a7-bb8b06615d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.643967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dd16e-141a-4cc8-b8a7-bb8b06615d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.644382 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dd16e-141a-4cc8-b8a7-bb8b06615d0f admin admin] PATH_INFO: `/v3/projects/47cca0df6e9e4252b3273dbfa06aa6bf/users/b5b99e0829e84f2bb0a58e835a1cdc47/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.647327 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798e1f2-9092-49bb-abb0-507528bbaf3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab1a23d8ead4f71956c5e90bbe29587, user_id=d21dce70b6444f0a9c129ae8bc6fdb38, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.650050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798e1f2-9092-49bb-abb0-507528bbaf3e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.659456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dd16e-141a-4cc8-b8a7-bb8b06615d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cca0df6e9e4252b3273dbfa06aa6bf, user_id=b5b99e0829e84f2bb0a58e835a1cdc47, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.662402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dd16e-141a-4cc8-b8a7-bb8b06615d0f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.723369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 784/1548] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:03 2021] PUT /identity/v3/projects/bab1a23d8ead4f71956c5e90bbe29587/users/d21dce70b6444f0a9c129ae8bc6fdb38/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:03.724270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798e1f2-9092-49bb-abb0-507528bbaf3e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.753046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 765/1549] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:03 2021] PUT /identity/v3/projects/47cca0df6e9e4252b3273dbfa06aa6bf/users/b5b99e0829e84f2bb0a58e835a1cdc47/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:03.755935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dd16e-141a-4cc8-b8a7-bb8b06615d0f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.789041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798e1f2-9092-49bb-abb0-507528bbaf3e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.814587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dd16e-141a-4cc8-b8a7-bb8b06615d0f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.819682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a73109-1aa2-4c43-bc4b-20c0171a3aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.820617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a73109-1aa2-4c43-bc4b-20c0171a3aea admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.820905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a73109-1aa2-4c43-bc4b-20c0171a3aea admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.821184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a73109-1aa2-4c43-bc4b-20c0171a3aea admin admin] PATH_INFO: `/v3/projects/2252ab66f4f64fa5a5d8fcb7ace33509/users/75cae7faa6a64b90aa5398adc4288503/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.835729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a73109-1aa2-4c43-bc4b-20c0171a3aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2252ab66f4f64fa5a5d8fcb7ace33509, user_id=75cae7faa6a64b90aa5398adc4288503, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.838586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a73109-1aa2-4c43-bc4b-20c0171a3aea admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.844981 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd6208-991c-40b2-bede-874da1974046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.845882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd6208-991c-40b2-bede-874da1974046 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.846165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd6208-991c-40b2-bede-874da1974046 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.846439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd6208-991c-40b2-bede-874da1974046 admin admin] PATH_INFO: `/v3/projects/a03ac913ba9947afb4a966b6191920cf/users/e6fee3e5dec649a99e67ae051b37002d/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.860571 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd6208-991c-40b2-bede-874da1974046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03ac913ba9947afb4a966b6191920cf, user_id=e6fee3e5dec649a99e67ae051b37002d, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.863290 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd6208-991c-40b2-bede-874da1974046 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.915581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 766/1550] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:03 2021] PUT /identity/v3/projects/2252ab66f4f64fa5a5d8fcb7ace33509/users/75cae7faa6a64b90aa5398adc4288503/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:03.916495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a73109-1aa2-4c43-bc4b-20c0171a3aea admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.946666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 785/1551] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:03 2021] PUT /identity/v3/projects/a03ac913ba9947afb4a966b6191920cf/users/e6fee3e5dec649a99e67ae051b37002d/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:03.948162 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730ec19-1250-4fd8-b516-a2c632f8d04b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.948382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730ec19-1250-4fd8-b516-a2c632f8d04b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.948722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730ec19-1250-4fd8-b516-a2c632f8d04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.968721 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b730ec19-1250-4fd8-b516-a2c632f8d04b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:03.969967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b730ec19-1250-4fd8-b516-a2c632f8d04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:04.004214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a73109-1aa2-4c43-bc4b-20c0171a3aea admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.038244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 786/1552] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:04.038244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae6300-d0c0-4fb4-9e05-a4c980cd874c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.038244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae6300-d0c0-4fb4-9e05-a4c980cd874c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.038244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae6300-d0c0-4fb4-9e05-a4c980cd874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.062225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88ea70-3e0c-491c-8bda-b666b2e71895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.062972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ea70-3e0c-491c-8bda-b666b2e71895 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.063261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ea70-3e0c-491c-8bda-b666b2e71895 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.063540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ea70-3e0c-491c-8bda-b666b2e71895 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.064270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88ea70-3e0c-491c-8bda-b666b2e71895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.065927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88ea70-3e0c-491c-8bda-b666b2e71895 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.072346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b6ae6300-d0c0-4fb4-9e05-a4c980cd874c None None] MFA Rules not processed for user `2b4505705320486aa4df292ee7c0041e`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:04.074098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b6ae6300-d0c0-4fb4-9e05-a4c980cd874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:04.076791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 767/1553] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:03 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:04.078169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01dd3d-a774-45c6-a490-4fcad42f5621 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.078491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01dd3d-a774-45c6-a490-4fcad42f5621 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.078926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01dd3d-a774-45c6-a490-4fcad42f5621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.096883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-6f01dd3d-a774-45c6-a490-4fcad42f5621 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:04.098120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6f01dd3d-a774-45c6-a490-4fcad42f5621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:04.110140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 768/1554] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:04.111623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183eedc-2758-4cc2-ba43-b027421a90be None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.111917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183eedc-2758-4cc2-ba43-b027421a90be None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.112195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183eedc-2758-4cc2-ba43-b027421a90be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.130790 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b183eedc-2758-4cc2-ba43-b027421a90be None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:04.132057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b183eedc-2758-4cc2-ba43-b027421a90be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:04.142240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 769/1555] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:04.149379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61083d24-6d99-43f7-ad80-dd419277467b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.150028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61083d24-6d99-43f7-ad80-dd419277467b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.150529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61083d24-6d99-43f7-ad80-dd419277467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.168449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-61083d24-6d99-43f7-ad80-dd419277467b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:04.169750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-61083d24-6d99-43f7-ad80-dd419277467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:04.171419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 787/1556] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:04 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:04.173040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19b56-fa3e-42ab-a773-2e09c433a6f6 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.173357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19b56-fa3e-42ab-a773-2e09c433a6f6 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.173662 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19b56-fa3e-42ab-a773-2e09c433a6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.180987 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 770/1557] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:04.182129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61083d24-6d99-43f7-ad80-dd419277467b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.209184 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-62f19b56-fa3e-42ab-a773-2e09c433a6f6 None None] MFA Rules not processed for user `e6fee3e5dec649a99e67ae051b37002d`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:04.210991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-62f19b56-fa3e-42ab-a773-2e09c433a6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:04.240865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61083d24-6d99-43f7-ad80-dd419277467b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.245528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de5211-b9fe-4faf-a61d-8bd953144403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.246476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de5211-b9fe-4faf-a61d-8bd953144403 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.246936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de5211-b9fe-4faf-a61d-8bd953144403 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.247410 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de5211-b9fe-4faf-a61d-8bd953144403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.257413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de5211-b9fe-4faf-a61d-8bd953144403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.258894 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de5211-b9fe-4faf-a61d-8bd953144403 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.269391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 771/1558] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:04.270169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de5211-b9fe-4faf-a61d-8bd953144403 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.279918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de5211-b9fe-4faf-a61d-8bd953144403 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.285102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d418355-cfe7-4068-af61-79a0a45742bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.286006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d418355-cfe7-4068-af61-79a0a45742bd admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.286283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d418355-cfe7-4068-af61-79a0a45742bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.286550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d418355-cfe7-4068-af61-79a0a45742bd admin admin] PATH_INFO: `/v3/projects/b85908db8d9e42b28ed05237bd3ffc7b/users/49ebfe2c4e6f44738260a54e337a71ef/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.287221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 788/1559] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:04 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:04.287810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19b56-fa3e-42ab-a773-2e09c433a6f6 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.297594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19b56-fa3e-42ab-a773-2e09c433a6f6 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.301443 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c028-c074-496f-ba93-35e593ee4b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.302096 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c028-c074-496f-ba93-35e593ee4b00 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.302382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c028-c074-496f-ba93-35e593ee4b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.302661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c028-c074-496f-ba93-35e593ee4b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.305585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d418355-cfe7-4068-af61-79a0a45742bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85908db8d9e42b28ed05237bd3ffc7b, user_id=49ebfe2c4e6f44738260a54e337a71ef, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.308391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d418355-cfe7-4068-af61-79a0a45742bd admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.312033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446c028-c074-496f-ba93-35e593ee4b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.313502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446c028-c074-496f-ba93-35e593ee4b00 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.324509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 789/1560] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:04.325363 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c028-c074-496f-ba93-35e593ee4b00 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.333695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c028-c074-496f-ba93-35e593ee4b00 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.337456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae3344-1a8b-49c7-8440-37d87a4cb826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.338096 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae3344-1a8b-49c7-8440-37d87a4cb826 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.338381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae3344-1a8b-49c7-8440-37d87a4cb826 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.338666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae3344-1a8b-49c7-8440-37d87a4cb826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.349224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae3344-1a8b-49c7-8440-37d87a4cb826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.358078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae3344-1a8b-49c7-8440-37d87a4cb826 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.360229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 790/1561] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:04.361019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae3344-1a8b-49c7-8440-37d87a4cb826 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.370271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae3344-1a8b-49c7-8440-37d87a4cb826 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.378137 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf22272-9797-4a83-9360-41048d8495c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.379271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf22272-9797-4a83-9360-41048d8495c2 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.379788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf22272-9797-4a83-9360-41048d8495c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.380346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf22272-9797-4a83-9360-41048d8495c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.386220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf22272-9797-4a83-9360-41048d8495c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.386220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf22272-9797-4a83-9360-41048d8495c2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.413722 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 772/1562] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:04 2021] PUT /identity/v3/projects/b85908db8d9e42b28ed05237bd3ffc7b/users/49ebfe2c4e6f44738260a54e337a71ef/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:04.415235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d418355-cfe7-4068-af61-79a0a45742bd admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.475836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d418355-cfe7-4068-af61-79a0a45742bd admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.479794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d4b0a-798f-4f7f-891c-c3ddd5404f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.480484 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d4b0a-798f-4f7f-891c-c3ddd5404f92 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.480773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d4b0a-798f-4f7f-891c-c3ddd5404f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.481082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d4b0a-798f-4f7f-891c-c3ddd5404f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.526227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 791/1563] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:04 2021] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:04.526227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf22272-9797-4a83-9360-41048d8495c2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.544148 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d4b0a-798f-4f7f-891c-c3ddd5404f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.545637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d4b0a-798f-4f7f-891c-c3ddd5404f92 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.557644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 773/1564] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:04.558671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d4b0a-798f-4f7f-891c-c3ddd5404f92 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.568737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d4b0a-798f-4f7f-891c-c3ddd5404f92 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.586326 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf22272-9797-4a83-9360-41048d8495c2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.591163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a31df-b9fe-4d74-8e1a-cda7b1b084af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.591858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a31df-b9fe-4d74-8e1a-cda7b1b084af admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.592150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a31df-b9fe-4d74-8e1a-cda7b1b084af admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.592512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a31df-b9fe-4d74-8e1a-cda7b1b084af admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.593201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a31df-b9fe-4d74-8e1a-cda7b1b084af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.595253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a31df-b9fe-4d74-8e1a-cda7b1b084af admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.630776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c227a5-4a15-4c90-a2d1-e2e2856440a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.631454 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c227a5-4a15-4c90-a2d1-e2e2856440a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.631740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c227a5-4a15-4c90-a2d1-e2e2856440a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.632020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c227a5-4a15-4c90-a2d1-e2e2856440a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.632813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c227a5-4a15-4c90-a2d1-e2e2856440a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.634489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c227a5-4a15-4c90-a2d1-e2e2856440a9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.645846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 774/1565] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:04 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:04.646533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c227a5-4a15-4c90-a2d1-e2e2856440a9 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.656925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c227a5-4a15-4c90-a2d1-e2e2856440a9 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.662328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e380c-1b52-4fa5-b3a6-6e50b12ebf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.662817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e380c-1b52-4fa5-b3a6-6e50b12ebf8a admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.663222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e380c-1b52-4fa5-b3a6-6e50b12ebf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.663424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e380c-1b52-4fa5-b3a6-6e50b12ebf8a admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.664098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e380c-1b52-4fa5-b3a6-6e50b12ebf8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.666436 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e380c-1b52-4fa5-b3a6-6e50b12ebf8a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.713274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 792/1566] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:04 2021] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:04.714175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a31df-b9fe-4d74-8e1a-cda7b1b084af admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.774079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a31df-b9fe-4d74-8e1a-cda7b1b084af admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.778635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336fe15-f05c-4d0a-a132-6783ac095285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.779622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336fe15-f05c-4d0a-a132-6783ac095285 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.779918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336fe15-f05c-4d0a-a132-6783ac095285 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.780225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336fe15-f05c-4d0a-a132-6783ac095285 admin admin] PATH_INFO: `/v3/projects/b85908db8d9e42b28ed05237bd3ffc7b/users/49ebfe2c4e6f44738260a54e337a71ef/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.782322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336fe15-f05c-4d0a-a132-6783ac095285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85908db8d9e42b28ed05237bd3ffc7b, user_id=49ebfe2c4e6f44738260a54e337a71ef, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.785113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336fe15-f05c-4d0a-a132-6783ac095285 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.793084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 775/1567] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:04 2021] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:04.796134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 793/1568] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:04 2021] PUT /identity/v3/projects/b85908db8d9e42b28ed05237bd3ffc7b/users/49ebfe2c4e6f44738260a54e337a71ef/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:04.797373 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e380c-1b52-4fa5-b3a6-6e50b12ebf8a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.798515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336fe15-f05c-4d0a-a132-6783ac095285 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.807182 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e380c-1b52-4fa5-b3a6-6e50b12ebf8a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.865782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336fe15-f05c-4d0a-a132-6783ac095285 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.866325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316705a6-2318-4fbf-abbf-2c283ffe3c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.866722 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316705a6-2318-4fbf-abbf-2c283ffe3c98 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.866956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316705a6-2318-4fbf-abbf-2c283ffe3c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.867293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316705a6-2318-4fbf-abbf-2c283ffe3c98 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.868049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316705a6-2318-4fbf-abbf-2c283ffe3c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.870264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316705a6-2318-4fbf-abbf-2c283ffe3c98 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.870530 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa39036-5d13-49d1-b226-573a2a727180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.871460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39036-5d13-49d1-b226-573a2a727180 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.871855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39036-5d13-49d1-b226-573a2a727180 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.872128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39036-5d13-49d1-b226-573a2a727180 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.872889 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa39036-5d13-49d1-b226-573a2a727180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.875046 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa39036-5d13-49d1-b226-573a2a727180 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.885601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 794/1569] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:04 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:04.886984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307092c7-8686-4202-98d3-834eb3761b2f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.887273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307092c7-8686-4202-98d3-834eb3761b2f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.887553 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307092c7-8686-4202-98d3-834eb3761b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.917474 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-307092c7-8686-4202-98d3-834eb3761b2f None None] MFA Rules not processed for user `49ebfe2c4e6f44738260a54e337a71ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:04.918719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-307092c7-8686-4202-98d3-834eb3761b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:04.963725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 776/1570] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:04 2021] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:04.963725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316705a6-2318-4fbf-abbf-2c283ffe3c98 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.974626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316705a6-2318-4fbf-abbf-2c283ffe3c98 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.980661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71701c-c85c-4632-a447-d9161fe51360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.981561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71701c-c85c-4632-a447-d9161fe51360 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.981839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71701c-c85c-4632-a447-d9161fe51360 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.982119 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71701c-c85c-4632-a447-d9161fe51360 admin admin] PATH_INFO: `/v3/projects/91e13035221547208d5bd56644941e87/users/d585e66aa9de4d24b3d25a5c9b249388/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.998663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71701c-c85c-4632-a447-d9161fe51360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e13035221547208d5bd56644941e87, user_id=d585e66aa9de4d24b3d25a5c9b249388, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.001448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71701c-c85c-4632-a447-d9161fe51360 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.007995 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 795/1571] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:04 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:05.008895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307092c7-8686-4202-98d3-834eb3761b2f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.019855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307092c7-8686-4202-98d3-834eb3761b2f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.024003 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60546b6d-76bd-4529-9454-c0db5be37a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.024809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60546b6d-76bd-4529-9454-c0db5be37a39 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.025186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60546b6d-76bd-4529-9454-c0db5be37a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.025552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60546b6d-76bd-4529-9454-c0db5be37a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.026391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60546b6d-76bd-4529-9454-c0db5be37a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.028098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60546b6d-76bd-4529-9454-c0db5be37a39 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.038857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 796/1572] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:05.039799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60546b6d-76bd-4529-9454-c0db5be37a39 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.091604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 777/1573] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:04 2021] PUT /identity/v3/projects/91e13035221547208d5bd56644941e87/users/d585e66aa9de4d24b3d25a5c9b249388/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:05.091604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71701c-c85c-4632-a447-d9161fe51360 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.109194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60546b6d-76bd-4529-9454-c0db5be37a39 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.182294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71701c-c85c-4632-a447-d9161fe51360 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.188569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad3d7-8f62-4898-8d34-d2b76fba0c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.189608 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad3d7-8f62-4898-8d34-d2b76fba0c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.190021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad3d7-8f62-4898-8d34-d2b76fba0c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.190388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad3d7-8f62-4898-8d34-d2b76fba0c57 admin admin] PATH_INFO: `/v3/projects/98e787aad6ec47739695c348b8222470/users/f466466c3d944b0582c3d9bad2bed447/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.205827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe10b68-d906-4aa0-a782-241df799e0d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.207319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe10b68-d906-4aa0-a782-241df799e0d5 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.207755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe10b68-d906-4aa0-a782-241df799e0d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.208207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe10b68-d906-4aa0-a782-241df799e0d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.212249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ad3d7-8f62-4898-8d34-d2b76fba0c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98e787aad6ec47739695c348b8222470, user_id=f466466c3d944b0582c3d9bad2bed447, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.217800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ad3d7-8f62-4898-8d34-d2b76fba0c57 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.285912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe10b68-d906-4aa0-a782-241df799e0d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.287516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe10b68-d906-4aa0-a782-241df799e0d5 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.298086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 797/1574] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:05 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:05.304594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe10b68-d906-4aa0-a782-241df799e0d5 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.310067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe10b68-d906-4aa0-a782-241df799e0d5 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.314960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5974c13-2f83-464d-884d-5f7cb1407d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.315739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974c13-2f83-464d-884d-5f7cb1407d07 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.316181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974c13-2f83-464d-884d-5f7cb1407d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.316600 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974c13-2f83-464d-884d-5f7cb1407d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.317424 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5974c13-2f83-464d-884d-5f7cb1407d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.319451 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5974c13-2f83-464d-884d-5f7cb1407d07 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.331869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 798/1575] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:05 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:05.336635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5974c13-2f83-464d-884d-5f7cb1407d07 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.348399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5974c13-2f83-464d-884d-5f7cb1407d07 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.353489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47963cb-ec17-4cc2-b663-7652933bceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.354390 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47963cb-ec17-4cc2-b663-7652933bceb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.354675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47963cb-ec17-4cc2-b663-7652933bceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.354954 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47963cb-ec17-4cc2-b663-7652933bceb4 admin admin] PATH_INFO: `/v3/projects/91e13035221547208d5bd56644941e87/users/d585e66aa9de4d24b3d25a5c9b249388/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.357054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47963cb-ec17-4cc2-b663-7652933bceb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e13035221547208d5bd56644941e87, user_id=d585e66aa9de4d24b3d25a5c9b249388, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.360413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47963cb-ec17-4cc2-b663-7652933bceb4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.375718 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 778/1576] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:05 2021] PUT /identity/v3/projects/98e787aad6ec47739695c348b8222470/users/f466466c3d944b0582c3d9bad2bed447/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:05.380405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 799/1577] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:05 2021] PUT /identity/v3/projects/91e13035221547208d5bd56644941e87/users/d585e66aa9de4d24b3d25a5c9b249388/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:05.383811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad3d7-8f62-4898-8d34-d2b76fba0c57 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.391570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381dd39-6caa-4a83-b382-0195d036dd45 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.392172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381dd39-6caa-4a83-b382-0195d036dd45 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.392510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381dd39-6caa-4a83-b382-0195d036dd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.439308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-3381dd39-6caa-4a83-b382-0195d036dd45 None None] MFA Rules not processed for user `d585e66aa9de4d24b3d25a5c9b249388`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:05.442706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-3381dd39-6caa-4a83-b382-0195d036dd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:05.487915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad3d7-8f62-4898-8d34-d2b76fba0c57 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.497690 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119be1c-5192-4374-bc67-a116178d3b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.500309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119be1c-5192-4374-bc67-a116178d3b90 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.500309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119be1c-5192-4374-bc67-a116178d3b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.500309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119be1c-5192-4374-bc67-a116178d3b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.500309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119be1c-5192-4374-bc67-a116178d3b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.502361 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119be1c-5192-4374-bc67-a116178d3b90 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.523825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 779/1578] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:05 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:05.533938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119be1c-5192-4374-bc67-a116178d3b90 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.547160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119be1c-5192-4374-bc67-a116178d3b90 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.575990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2e66d-3172-4d77-8b90-c9d9caf8eee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.583435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e66d-3172-4d77-8b90-c9d9caf8eee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.583435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e66d-3172-4d77-8b90-c9d9caf8eee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.583435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e66d-3172-4d77-8b90-c9d9caf8eee1 admin admin] PATH_INFO: `/v3/projects/98e787aad6ec47739695c348b8222470/users/f466466c3d944b0582c3d9bad2bed447/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.583435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2e66d-3172-4d77-8b90-c9d9caf8eee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98e787aad6ec47739695c348b8222470, user_id=f466466c3d944b0582c3d9bad2bed447, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.584140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2e66d-3172-4d77-8b90-c9d9caf8eee1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.601973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 800/1580] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:05 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:05.609990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 780/1580] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:05 2021] PUT /identity/v3/projects/98e787aad6ec47739695c348b8222470/users/f466466c3d944b0582c3d9bad2bed447/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:05.610434 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381dd39-6caa-4a83-b382-0195d036dd45 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.611544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ff10-63be-4103-821c-3dd295659a77 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.611836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ff10-63be-4103-821c-3dd295659a77 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.612114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ff10-63be-4103-821c-3dd295659a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.621839 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381dd39-6caa-4a83-b382-0195d036dd45 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.644861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-55b3ff10-63be-4103-821c-3dd295659a77 None None] MFA Rules not processed for user `f466466c3d944b0582c3d9bad2bed447`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:05.646210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-55b3ff10-63be-4103-821c-3dd295659a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:05.694231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.695566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.695566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.695806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] PATH_INFO: `/v3/users/f0a68d844864490f97d5f8737519afd6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.696978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a68d844864490f97d5f8737519afd6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.699160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.739911 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 781/1581] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:05 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:05.739911 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ff10-63be-4103-821c-3dd295659a77 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.800470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ff10-63be-4103-821c-3dd295659a77 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.804594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac396d-6d96-4f60-98ed-b023b227a3b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.805261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac396d-6d96-4f60-98ed-b023b227a3b9 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.805599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac396d-6d96-4f60-98ed-b023b227a3b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.805820 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac396d-6d96-4f60-98ed-b023b227a3b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.879055 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac396d-6d96-4f60-98ed-b023b227a3b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.880512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac396d-6d96-4f60-98ed-b023b227a3b9 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.890475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 782/1582] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:05 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:05.891570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac396d-6d96-4f60-98ed-b023b227a3b9 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.899560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac396d-6d96-4f60-98ed-b023b227a3b9 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.903586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77fdbb-2dc3-4ffa-b4c7-085a3d9e3d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.904915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77fdbb-2dc3-4ffa-b4c7-085a3d9e3d56 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.905206 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77fdbb-2dc3-4ffa-b4c7-085a3d9e3d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.905476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77fdbb-2dc3-4ffa-b4c7-085a3d9e3d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.905779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a68d844864490f97d5f8737519afd6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.915477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77fdbb-2dc3-4ffa-b4c7-085a3d9e3d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.916976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77fdbb-2dc3-4ffa-b4c7-085a3d9e3d56 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.919085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a68d844864490f97d5f8737519afd6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.920499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a68d844864490f97d5f8737519afd6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.933247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a68d844864490f97d5f8737519afd6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.933390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 783/1583] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:05 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:05.947630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77fdbb-2dc3-4ffa-b4c7-085a3d9e3d56 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.956472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77fdbb-2dc3-4ffa-b4c7-085a3d9e3d56 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.960502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d49e9-c3bf-4229-a767-e5228f220738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.961925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d49e9-c3bf-4229-a767-e5228f220738 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.961925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d49e9-c3bf-4229-a767-e5228f220738 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.961925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d49e9-c3bf-4229-a767-e5228f220738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.012998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-bacc036e-9c08-41a6-8d3a-386aa74515cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a68d844864490f97d5f8737519afd6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:06.025554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d49e9-c3bf-4229-a767-e5228f220738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:06.025554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d49e9-c3bf-4229-a767-e5228f220738 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:06.026458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 801/1584] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:05 2021] DELETE /identity/v3/users/f0a68d844864490f97d5f8737519afd6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:06.028232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03eb6d-5dcc-4246-97ba-039198d5b1bb None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.031043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03eb6d-5dcc-4246-97ba-039198d5b1bb None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.031582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03eb6d-5dcc-4246-97ba-039198d5b1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.036797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 784/1585] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:05 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:06.064287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ba03eb6d-5dcc-4246-97ba-039198d5b1bb None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:06.065479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ba03eb6d-5dcc-4246-97ba-039198d5b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:06.148558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 802/1586] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:06.159759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d49e9-c3bf-4229-a767-e5228f220738 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:06.220747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d49e9-c3bf-4229-a767-e5228f220738 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:06.270020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33fe8-69e5-476b-b549-c4be014de4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:06.270814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33fe8-69e5-476b-b549-c4be014de4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.271103 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33fe8-69e5-476b-b549-c4be014de4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.271379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33fe8-69e5-476b-b549-c4be014de4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.296464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33fe8-69e5-476b-b549-c4be014de4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:06.298334 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33fe8-69e5-476b-b549-c4be014de4f5 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:06.311283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 785/1587] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:06.343419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03eb6d-5dcc-4246-97ba-039198d5b1bb None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:06.345000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ba03eb6d-5dcc-4246-97ba-039198d5b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:06.442737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03eb6d-5dcc-4246-97ba-039198d5b1bb None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:06.453896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dab0a-2957-402f-8f50-8c48b7e6cc71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:06.454988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dab0a-2957-402f-8f50-8c48b7e6cc71 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.455420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dab0a-2957-402f-8f50-8c48b7e6cc71 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.456030 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dab0a-2957-402f-8f50-8c48b7e6cc71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.458309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-bd5dab0a-2957-402f-8f50-8c48b7e6cc71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:06.535276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dab0a-2957-402f-8f50-8c48b7e6cc71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:06.537647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dab0a-2957-402f-8f50-8c48b7e6cc71 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:06.561147 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 803/1588] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:06 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:06.617100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77999-31ae-45d4-b47a-d5c96e1ff36f None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.617495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77999-31ae-45d4-b47a-d5c96e1ff36f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.617881 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77999-31ae-45d4-b47a-d5c96e1ff36f None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.620310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 786/1589] 10.222.0.25 () {54 vars in 961 bytes} [Fri Aug 27 04:44:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:44:06.627305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dac9a-5c20-4afc-af83-45caf027ced5 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.627643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dac9a-5c20-4afc-af83-45caf027ced5 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.628064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dac9a-5c20-4afc-af83-45caf027ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.646879 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d28dac9a-5c20-4afc-af83-45caf027ced5 None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:06.648098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d28dac9a-5c20-4afc-af83-45caf027ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:06.735021 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 804/1590] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Aug 27 04:44:06 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:06.740577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78a58-e62b-4d2b-a45f-3ed51dd5a051 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.740869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78a58-e62b-4d2b-a45f-3ed51dd5a051 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.741274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78a58-e62b-4d2b-a45f-3ed51dd5a051 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.742980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 787/1591] 10.222.0.25 () {54 vars in 912 bytes} [Fri Aug 27 04:44:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:44:06.749514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e882-f4e7-4840-9e67-a2e3bc09b90c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.749809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e882-f4e7-4840-9e67-a2e3bc09b90c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.750093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e882-f4e7-4840-9e67-a2e3bc09b90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.781404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-aa63e882-f4e7-4840-9e67-a2e3bc09b90c None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:06.783162 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-aa63e882-f4e7-4840-9e67-a2e3bc09b90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:06.806684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 805/1592] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:44:06 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:06.872212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd78a58-e62b-4d2b-a45f-3ed51dd5a051 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:06.875008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5dd78a58-e62b-4d2b-a45f-3ed51dd5a051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:06.893509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd78a58-e62b-4d2b-a45f-3ed51dd5a051 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:06.898554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ee7e7-c262-4fa8-a9f5-a7351b30a90e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:06.898923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ee7e7-c262-4fa8-a9f5-a7351b30a90e service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.899305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ee7e7-c262-4fa8-a9f5-a7351b30a90e service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.899717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ee7e7-c262-4fa8-a9f5-a7351b30a90e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.916037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ee7e7-c262-4fa8-a9f5-a7351b30a90e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:06.917802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ee7e7-c262-4fa8-a9f5-a7351b30a90e service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:06.929711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0775d-81ef-42ab-b0e0-9a551961b246 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.930175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0775d-81ef-42ab-b0e0-9a551961b246 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.930440 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0775d-81ef-42ab-b0e0-9a551961b246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.959947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 788/1593] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:06.997172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f1d0775d-81ef-42ab-b0e0-9a551961b246 None None] MFA Rules not processed for user `6e3d01958d7647bc86f2d555c4e1a6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:07.000369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f1d0775d-81ef-42ab-b0e0-9a551961b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.088673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 806/1594] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:06 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:07.090485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e54ef9-8438-48e8-bf55-22fb4f836607 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.091050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e54ef9-8438-48e8-bf55-22fb4f836607 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.091511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e54ef9-8438-48e8-bf55-22fb4f836607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.114043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71055e4-569d-48df-a851-31a151f91a24 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.114043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71055e4-569d-48df-a851-31a151f91a24 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.114043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71055e4-569d-48df-a851-31a151f91a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.149239 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b71055e4-569d-48df-a851-31a151f91a24 None None] MFA Rules not processed for user `6e3d01958d7647bc86f2d555c4e1a6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:07.149971 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b71055e4-569d-48df-a851-31a151f91a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.166837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 807/1595] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:07 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:07.173401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-47e54ef9-8438-48e8-bf55-22fb4f836607 None None] MFA Rules not processed for user `b5b99e0829e84f2bb0a58e835a1cdc47`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:07.183006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-47e54ef9-8438-48e8-bf55-22fb4f836607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.205376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40db170-775b-4459-8aed-10bd2b1c9696 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.205376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40db170-775b-4459-8aed-10bd2b1c9696 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.205376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40db170-775b-4459-8aed-10bd2b1c9696 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.207052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 808/1596] 10.222.0.25 () {54 vars in 961 bytes} [Fri Aug 27 04:44:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:44:07.208186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40db170-775b-4459-8aed-10bd2b1c9696 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:07.218048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a40db170-775b-4459-8aed-10bd2b1c9696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.245698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40db170-775b-4459-8aed-10bd2b1c9696 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:07.261141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:07.262024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.262866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.262866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] PATH_INFO: `/v3/projects/69be034484ab4476a6a5647dda070eff` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.265293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69be034484ab4476a6a5647dda070eff)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:07.267987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: WARNING py.warnings [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:44:07.267987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: warnings.warn(msg) Aug 27 04:44:07.267987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: Aug 27 04:44:07.269509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:07.389459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 789/1597] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:07 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:07.391449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9cad-04f4-4fa0-a710-ea227acf606f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.391951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9cad-04f4-4fa0-a710-ea227acf606f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.392520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9cad-04f4-4fa0-a710-ea227acf606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.433122 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-066c9cad-04f4-4fa0-a710-ea227acf606f None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:07.434440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-066c9cad-04f4-4fa0-a710-ea227acf606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.447256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 790/1598] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Aug 27 04:44:07 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:07.449155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ede1c-df22-46e2-88aa-1b0b91211047 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.449497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ede1c-df22-46e2-88aa-1b0b91211047 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.449824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ede1c-df22-46e2-88aa-1b0b91211047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.490224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-6b4ede1c-df22-46e2-88aa-1b0b91211047 None None] MFA Rules not processed for user `b5b99e0829e84f2bb0a58e835a1cdc47`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:07.491738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6b4ede1c-df22-46e2-88aa-1b0b91211047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.506409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69be034484ab4476a6a5647dda070eff', 'request_id': 'req-28971225-8b98-4d7b-9975-9eed9f0f7977'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:07.524963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69be034484ab4476a6a5647dda070eff', 'request_id': 'req-28971225-8b98-4d7b-9975-9eed9f0f7977'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:07.532470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69be034484ab4476a6a5647dda070eff', 'request_id': 'req-28971225-8b98-4d7b-9975-9eed9f0f7977'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:07.558634 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 791/1599] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:07 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:07.559782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ede1c-df22-46e2-88aa-1b0b91211047 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:07.743781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] The token cache is being invalidate because project 69be034484ab4476a6a5647dda070eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:07.744100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:07.745438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:07.750552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 809/1600] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:07 2021] DELETE /identity/v3/projects/69be034484ab4476a6a5647dda070eff => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:07.754038 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:07.754543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.766594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ede1c-df22-46e2-88aa-1b0b91211047 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:07.776540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50894e5-ef99-4ff3-9e93-470b9221d055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:07.777592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50894e5-ef99-4ff3-9e93-470b9221d055 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.777954 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50894e5-ef99-4ff3-9e93-470b9221d055 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.778287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50894e5-ef99-4ff3-9e93-470b9221d055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.778840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28971225-8b98-4d7b-9975-9eed9f0f7977 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:07.781538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c50894e5-ef99-4ff3-9e93-470b9221d055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.785121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d62b8-6435-4e88-a846-938c20f32372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:07.785992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d62b8-6435-4e88-a846-938c20f32372 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.786426 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d62b8-6435-4e88-a846-938c20f32372 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.786872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d62b8-6435-4e88-a846-938c20f32372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.788850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8c6d62b8-6435-4e88-a846-938c20f32372 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.803388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d62b8-6435-4e88-a846-938c20f32372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:07.805572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d62b8-6435-4e88-a846-938c20f32372 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:07.818267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 810/1601] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:07 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:07.819423 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d62b8-6435-4e88-a846-938c20f32372 service nova] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:07.820867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8c6d62b8-6435-4e88-a846-938c20f32372 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.894559 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50894e5-ef99-4ff3-9e93-470b9221d055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:07.895080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d62b8-6435-4e88-a846-938c20f32372 service nova] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:07.895617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50894e5-ef99-4ff3-9e93-470b9221d055 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:07.900498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:07.906134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.906134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.906134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] PATH_INFO: `/v3/users/49ebfe2c4e6f44738260a54e337a71ef` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.906134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ebfe2c4e6f44738260a54e337a71ef)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:07.906134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:07.919593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 792/1602] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:07 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:08.124787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ebfe2c4e6f44738260a54e337a71ef'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:08.152581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ebfe2c4e6f44738260a54e337a71ef'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:08.174181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ebfe2c4e6f44738260a54e337a71ef'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:08.175479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ebfe2c4e6f44738260a54e337a71ef'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:08.266780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6c409152-c06f-4035-b81f-3f7147c827f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ebfe2c4e6f44738260a54e337a71ef'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:08.273799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 811/1603] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:07 2021] DELETE /identity/v3/users/49ebfe2c4e6f44738260a54e337a71ef => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:08.309743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6b56-74c5-40ba-a0c3-3ab4dcb3076c None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.310037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6b56-74c5-40ba-a0c3-3ab4dcb3076c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.311065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6b56-74c5-40ba-a0c3-3ab4dcb3076c None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:08.314364 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 793/1604] 10.222.0.25 () {54 vars in 912 bytes} [Fri Aug 27 04:44:08 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:44:08.324485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b230-8cc3-4814-b646-198244b0d0ec None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.324863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b230-8cc3-4814-b646-198244b0d0ec None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.325208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b230-8cc3-4814-b646-198244b0d0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:08.386057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4f31b230-8cc3-4814-b646-198244b0d0ec None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:08.388260 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4f31b230-8cc3-4814-b646-198244b0d0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:08.553798 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 812/1605] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:44:08 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:08.568312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a6b56-74c5-40ba-a0c3-3ab4dcb3076c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:08.570385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-db6a6b56-74c5-40ba-a0c3-3ab4dcb3076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:08.582409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69bf6a-800f-49b5-b49f-21d04b02bc60 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.582706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69bf6a-800f-49b5-b49f-21d04b02bc60 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.582987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69bf6a-800f-49b5-b49f-21d04b02bc60 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:08.585299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 813/1606] 10.222.0.25 () {54 vars in 912 bytes} [Fri Aug 27 04:44:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:44:08.591187 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b097-8af7-4851-bf0a-e75a46d1ce37 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.591854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b097-8af7-4851-bf0a-e75a46d1ce37 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.591854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b097-8af7-4851-bf0a-e75a46d1ce37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:08.686827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-0783b097-8af7-4851-bf0a-e75a46d1ce37 None None] MFA Rules not processed for user `a95d2eadd8c7455bb70477e4522c74c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:08.687982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0783b097-8af7-4851-bf0a-e75a46d1ce37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:08.711470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a6b56-74c5-40ba-a0c3-3ab4dcb3076c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:08.717462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b7eca-d6a4-41da-b4df-621dd170fc2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f041d8d6b5949c48920b729511f3783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:08.718159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b7eca-d6a4-41da-b4df-621dd170fc2e service glance] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.718441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b7eca-d6a4-41da-b4df-621dd170fc2e service glance] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.718759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b7eca-d6a4-41da-b4df-621dd170fc2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:08.738157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b7eca-d6a4-41da-b4df-621dd170fc2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:08.739682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b7eca-d6a4-41da-b4df-621dd170fc2e service glance] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:08.756189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 794/1607] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:08 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:08.801867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 814/1608] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:44:08 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:08.843933 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b7eca-d6a4-41da-b4df-621dd170fc2e service glance] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:08.845481 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-918b7eca-d6a4-41da-b4df-621dd170fc2e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:08.871107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b7eca-d6a4-41da-b4df-621dd170fc2e service glance] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:08.875895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cf1a-bc22-4ed9-9a6c-ed2e608515a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:08.880558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cf1a-bc22-4ed9-9a6c-ed2e608515a3 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.880558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cf1a-bc22-4ed9-9a6c-ed2e608515a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.880558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cf1a-bc22-4ed9-9a6c-ed2e608515a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:08.888125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8cf1a-bc22-4ed9-9a6c-ed2e608515a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:08.890172 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8cf1a-bc22-4ed9-9a6c-ed2e608515a3 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:08.900648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 795/1609] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:08 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:09.323767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e427-4a17-4f66-a051-ecf35184efc1 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:09.324612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e427-4a17-4f66-a051-ecf35184efc1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:09.325241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e427-4a17-4f66-a051-ecf35184efc1 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:09.327293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 815/1610] 10.222.0.25 () {54 vars in 912 bytes} [Fri Aug 27 04:44:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:44:09.334986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d54da-04f9-4388-90e2-4b4ad8c032d2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:09.334986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d54da-04f9-4388-90e2-4b4ad8c032d2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:09.335381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d54da-04f9-4388-90e2-4b4ad8c032d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:09.381590 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3a2d54da-04f9-4388-90e2-4b4ad8c032d2 None None] MFA Rules not processed for user `a95d2eadd8c7455bb70477e4522c74c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:09.383101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3a2d54da-04f9-4388-90e2-4b4ad8c032d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:09.406795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 796/1611] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:44:09 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:09.438786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e427-4a17-4f66-a051-ecf35184efc1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:09.440883 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-11f8e427-4a17-4f66-a051-ecf35184efc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:09.464415 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e427-4a17-4f66-a051-ecf35184efc1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:09.473151 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767758de-3a2c-4347-a57f-24fd50d7714b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:09.473852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767758de-3a2c-4347-a57f-24fd50d7714b service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:09.474140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767758de-3a2c-4347-a57f-24fd50d7714b service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:09.474418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767758de-3a2c-4347-a57f-24fd50d7714b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:09.485337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767758de-3a2c-4347-a57f-24fd50d7714b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:09.487220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767758de-3a2c-4347-a57f-24fd50d7714b service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:09.516960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 816/1612] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:09 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:09.603822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d54da-04f9-4388-90e2-4b4ad8c032d2 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:09.605785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3a2d54da-04f9-4388-90e2-4b4ad8c032d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:09.749268 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d54da-04f9-4388-90e2-4b4ad8c032d2 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:09.761803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:09.762709 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:09.762991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:09.763343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] PATH_INFO: `/v3/projects/b85908db8d9e42b28ed05237bd3ffc7b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:09.766203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85908db8d9e42b28ed05237bd3ffc7b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:09.768190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:09.952733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85908db8d9e42b28ed05237bd3ffc7b', 'request_id': 'req-bd745afc-0ba3-4f29-b995-4701eeca4c4d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:10.054524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85908db8d9e42b28ed05237bd3ffc7b', 'request_id': 'req-bd745afc-0ba3-4f29-b995-4701eeca4c4d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:10.061069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85908db8d9e42b28ed05237bd3ffc7b', 'request_id': 'req-bd745afc-0ba3-4f29-b995-4701eeca4c4d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:10.070500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767758de-3a2c-4347-a57f-24fd50d7714b service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:10.072450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-767758de-3a2c-4347-a57f-24fd50d7714b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:10.109201 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] The token cache is being invalidate because project b85908db8d9e42b28ed05237bd3ffc7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:10.109913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:10.112624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bd745afc-0ba3-4f29-b995-4701eeca4c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:10.129083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 797/1613] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:09 2021] DELETE /identity/v3/projects/b85908db8d9e42b28ed05237bd3ffc7b => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:10.130866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e849d7c-1d66-4be0-bb45-593573f0d211 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.131587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e849d7c-1d66-4be0-bb45-593573f0d211 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.131956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e849d7c-1d66-4be0-bb45-593573f0d211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.175865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-9e849d7c-1d66-4be0-bb45-593573f0d211 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:10.177516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9e849d7c-1d66-4be0-bb45-593573f0d211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:10.286459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 798/1614] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:10.288746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf8a0-3cc9-44db-a383-534ec37e587b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.289228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf8a0-3cc9-44db-a383-534ec37e587b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.289883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf8a0-3cc9-44db-a383-534ec37e587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.298147 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767758de-3a2c-4347-a57f-24fd50d7714b service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:10.309548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-adacf8a0-3cc9-44db-a383-534ec37e587b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:10.311754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-adacf8a0-3cc9-44db-a383-534ec37e587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:10.325285 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 799/1615] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:10.326669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf8a0-3cc9-44db-a383-534ec37e587b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:10.347270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf8a0-3cc9-44db-a383-534ec37e587b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:10.353144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13065d-608b-43b2-a57a-c1a7f9942b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:10.354065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13065d-608b-43b2-a57a-c1a7f9942b81 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.355072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13065d-608b-43b2-a57a-c1a7f9942b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.355072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13065d-608b-43b2-a57a-c1a7f9942b81 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.356340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13065d-608b-43b2-a57a-c1a7f9942b81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:10.356674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13065d-608b-43b2-a57a-c1a7f9942b81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:10.359388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13065d-608b-43b2-a57a-c1a7f9942b81 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:10.390653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 800/1616] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:10.396432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13065d-608b-43b2-a57a-c1a7f9942b81 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:10.410770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13065d-608b-43b2-a57a-c1a7f9942b81 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:10.416280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665941e-e9f2-46e7-a25a-584a1aab5304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:10.417151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665941e-e9f2-46e7-a25a-584a1aab5304 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.417504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665941e-e9f2-46e7-a25a-584a1aab5304 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.417868 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665941e-e9f2-46e7-a25a-584a1aab5304 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.418992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665941e-e9f2-46e7-a25a-584a1aab5304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:10.420991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f736c-7b81-4d69-a1b1-51ae05553717 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:10.422066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665941e-e9f2-46e7-a25a-584a1aab5304 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:10.422526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f736c-7b81-4d69-a1b1-51ae05553717 service placement] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.423014 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f736c-7b81-4d69-a1b1-51ae05553717 service placement] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.423467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f736c-7b81-4d69-a1b1-51ae05553717 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.426110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-206f736c-7b81-4d69-a1b1-51ae05553717 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:10.439392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f736c-7b81-4d69-a1b1-51ae05553717 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:10.450607 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f736c-7b81-4d69-a1b1-51ae05553717 service placement] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:10.488567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 817/1617] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:10 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:10.567108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 801/1618] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:10 2021] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:10.568453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f736c-7b81-4d69-a1b1-51ae05553717 service placement] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:10.582897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f736c-7b81-4d69-a1b1-51ae05553717 service placement] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:10.729472 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e7826-9eb6-419b-8770-601891a6f0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:10.730567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e7826-9eb6-419b-8770-601891a6f0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.730942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e7826-9eb6-419b-8770-601891a6f0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.731273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e7826-9eb6-419b-8770-601891a6f0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.732054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e7826-9eb6-419b-8770-601891a6f0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:10.739304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e7826-9eb6-419b-8770-601891a6f0b7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:10.875580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 818/1619] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:10 2021] POST /identity/v3/users => generated 303 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:10.876654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665941e-e9f2-46e7-a25a-584a1aab5304 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:10.895983 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665941e-e9f2-46e7-a25a-584a1aab5304 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:10.922649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a496-b6f8-4dba-8a42-7fbe2be08462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:10.924707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a496-b6f8-4dba-8a42-7fbe2be08462 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.925000 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a496-b6f8-4dba-8a42-7fbe2be08462 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.927630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a496-b6f8-4dba-8a42-7fbe2be08462 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.930798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8a496-b6f8-4dba-8a42-7fbe2be08462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:10.934336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8a496-b6f8-4dba-8a42-7fbe2be08462 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:10.975132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 802/1620] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:10 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:10.983446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e7826-9eb6-419b-8770-601891a6f0b7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:11.009577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e7826-9eb6-419b-8770-601891a6f0b7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:11.042145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612ffc-922e-45fa-86be-53ca15fbe127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:11.043563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612ffc-922e-45fa-86be-53ca15fbe127 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:11.043989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612ffc-922e-45fa-86be-53ca15fbe127 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:11.044849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612ffc-922e-45fa-86be-53ca15fbe127 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:11.046410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97612ffc-922e-45fa-86be-53ca15fbe127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:11.056548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97612ffc-922e-45fa-86be-53ca15fbe127 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:11.092733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a496-b6f8-4dba-8a42-7fbe2be08462 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:11.095377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 819/1621] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:10 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:11.114825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a496-b6f8-4dba-8a42-7fbe2be08462 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:11.125287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86399c0c-d254-4f1d-a702-e898e5b1cd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:11.126223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399c0c-d254-4f1d-a702-e898e5b1cd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:11.127174 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399c0c-d254-4f1d-a702-e898e5b1cd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:11.128048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399c0c-d254-4f1d-a702-e898e5b1cd31 admin admin] PATH_INFO: `/v3/projects/f618c73686df4473a8f2c15b1ebbb24d/users/8e449e285a7a43d6a58f335ca4ee90ee/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:11.166023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86399c0c-d254-4f1d-a702-e898e5b1cd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f618c73686df4473a8f2c15b1ebbb24d, user_id=8e449e285a7a43d6a58f335ca4ee90ee, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:11.169257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86399c0c-d254-4f1d-a702-e898e5b1cd31 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:11.299003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 803/1622] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:11 2021] PUT /identity/v3/projects/f618c73686df4473a8f2c15b1ebbb24d/users/8e449e285a7a43d6a58f335ca4ee90ee/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:11.306037 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555701-ce1c-41e2-9b34-d044f40da20a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:11.306037 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555701-ce1c-41e2-9b34-d044f40da20a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:11.306037 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555701-ce1c-41e2-9b34-d044f40da20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:11.361407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f7555701-ce1c-41e2-9b34-d044f40da20a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:11.363515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f7555701-ce1c-41e2-9b34-d044f40da20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:11.496370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 820/1623] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:11.539063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86399c0c-d254-4f1d-a702-e898e5b1cd31 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:11.545684 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-86399c0c-d254-4f1d-a702-e898e5b1cd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:11.695918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86399c0c-d254-4f1d-a702-e898e5b1cd31 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:11.712252 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d53e52-d73c-46de-9368-3acee88109af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:11.713297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d53e52-d73c-46de-9368-3acee88109af service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:11.713606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d53e52-d73c-46de-9368-3acee88109af service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:11.715557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d53e52-d73c-46de-9368-3acee88109af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:11.755752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d53e52-d73c-46de-9368-3acee88109af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:11.757198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d53e52-d73c-46de-9368-3acee88109af service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:11.784025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 804/1624] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:12.498769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7555701-ce1c-41e2-9b34-d044f40da20a None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:12.500407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f7555701-ce1c-41e2-9b34-d044f40da20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:12.521349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7555701-ce1c-41e2-9b34-d044f40da20a None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:12.531280 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:12.533396 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:12.536761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:12.537368 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] PATH_INFO: `/v3/users/2b4505705320486aa4df292ee7c0041e` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:12.547643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4505705320486aa4df292ee7c0041e)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:12.547643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:12.799752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4505705320486aa4df292ee7c0041e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:12.831373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4505705320486aa4df292ee7c0041e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:12.833744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4505705320486aa4df292ee7c0041e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:12.851497 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4505705320486aa4df292ee7c0041e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:12.940418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4505705320486aa4df292ee7c0041e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:12.949063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 821/1625] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:12 2021] DELETE /identity/v3/users/2b4505705320486aa4df292ee7c0041e => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:12.952939 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7af40-e18a-4fb3-84a5-5c04649f2fb5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:12.953420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7af40-e18a-4fb3-84a5-5c04649f2fb5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:12.953534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7af40-e18a-4fb3-84a5-5c04649f2fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:13.003008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e9a7af40-e18a-4fb3-84a5-5c04649f2fb5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:13.007696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e9a7af40-e18a-4fb3-84a5-5c04649f2fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:13.169286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 805/1626] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:13.204639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:13.206161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:13.336881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caea6a8-7ffa-4e1a-ab65-17615b3bafd2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:13.346577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e492bcc-8862-467d-92cc-1bdba04177e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:13.347271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e492bcc-8862-467d-92cc-1bdba04177e9 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:13.347562 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e492bcc-8862-467d-92cc-1bdba04177e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:13.350960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e492bcc-8862-467d-92cc-1bdba04177e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:13.371490 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e492bcc-8862-467d-92cc-1bdba04177e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:13.373897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e492bcc-8862-467d-92cc-1bdba04177e9 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:13.389103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 822/1627] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:14.722510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7af40-e18a-4fb3-84a5-5c04649f2fb5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:14.725624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e9a7af40-e18a-4fb3-84a5-5c04649f2fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:14.763195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7af40-e18a-4fb3-84a5-5c04649f2fb5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:14.798162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:14.802085 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:14.804266 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:14.806008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] PATH_INFO: `/v3/projects/92c62b314d6847ee9e2914da673983f8` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:14.809354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c62b314d6847ee9e2914da673983f8)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:14.815923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:14.994366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecdf39-9762-4bd4-8d82-02b44a83f44e None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:14.995726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecdf39-9762-4bd4-8d82-02b44a83f44e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:14.996190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecdf39-9762-4bd4-8d82-02b44a83f44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:15.005955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c62b314d6847ee9e2914da673983f8', 'request_id': 'req-99d446ac-8a5a-457a-963b-1299a7f1f3ca'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:15.035230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-76ecdf39-9762-4bd4-8d82-02b44a83f44e None None] MFA Rules not processed for user `8e449e285a7a43d6a58f335ca4ee90ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:15.036871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-76ecdf39-9762-4bd4-8d82-02b44a83f44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:15.087403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c62b314d6847ee9e2914da673983f8', 'request_id': 'req-99d446ac-8a5a-457a-963b-1299a7f1f3ca'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:15.107252 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c62b314d6847ee9e2914da673983f8', 'request_id': 'req-99d446ac-8a5a-457a-963b-1299a7f1f3ca'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:15.140002 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] The token cache is being invalidate because project 92c62b314d6847ee9e2914da673983f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:15.143214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:15.143214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:15.144553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 806/1628] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:14 2021] DELETE /identity/v3/projects/92c62b314d6847ee9e2914da673983f8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:15.148139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:15.151989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:15.219676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 823/1629] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:14 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:15.223832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecdf39-9762-4bd4-8d82-02b44a83f44e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:15.229673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-76ecdf39-9762-4bd4-8d82-02b44a83f44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:15.302435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d446ac-8a5a-457a-963b-1299a7f1f3ca admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:15.311121 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:15.312677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:15.313836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:15.314361 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] PATH_INFO: `/v3/users/d585e66aa9de4d24b3d25a5c9b249388` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:15.315920 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d585e66aa9de4d24b3d25a5c9b249388)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:15.318363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: WARNING py.warnings [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:44:15.318363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: warnings.warn(msg) Aug 27 04:44:15.318363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: Aug 27 04:44:15.320835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:15.341198 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecdf39-9762-4bd4-8d82-02b44a83f44e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:15.365869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04375dc8-72a9-4c06-b373-5737a9059e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:15.368723 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04375dc8-72a9-4c06-b373-5737a9059e12 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:15.369213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04375dc8-72a9-4c06-b373-5737a9059e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:15.371321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04375dc8-72a9-4c06-b373-5737a9059e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:15.372437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04375dc8-72a9-4c06-b373-5737a9059e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:15.377077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04375dc8-72a9-4c06-b373-5737a9059e12 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:15.530949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 824/1630] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:15 2021] POST /identity/v3/projects => generated 403 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:15.541644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04375dc8-72a9-4c06-b373-5737a9059e12 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:15.655529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd585e66aa9de4d24b3d25a5c9b249388'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:15.661255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd585e66aa9de4d24b3d25a5c9b249388'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:15.661803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd585e66aa9de4d24b3d25a5c9b249388'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:15.730511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd585e66aa9de4d24b3d25a5c9b249388'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:15.760604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04375dc8-72a9-4c06-b373-5737a9059e12 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:15.779902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c4b06-dc19-42b1-b74f-c101428710ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:15.780624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c4b06-dc19-42b1-b74f-c101428710ee admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:15.781241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c4b06-dc19-42b1-b74f-c101428710ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:15.781765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c4b06-dc19-42b1-b74f-c101428710ee admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:15.782628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c4b06-dc19-42b1-b74f-c101428710ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:15.785606 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c4b06-dc19-42b1-b74f-c101428710ee admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:15.930016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd585e66aa9de4d24b3d25a5c9b249388'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:15.939670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 825/1631] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:15 2021] POST /identity/v3/users => generated 308 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:15.939670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a5f9-3287-46a4-86d0-10c77d82ec4f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:15.939670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a5f9-3287-46a4-86d0-10c77d82ec4f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:15.939670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a5f9-3287-46a4-86d0-10c77d82ec4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:15.968058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 807/1632] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:15 2021] DELETE /identity/v3/users/d585e66aa9de4d24b3d25a5c9b249388 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:15.969212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:15.974945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:16.009747 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-2b76a5f9-3287-46a4-86d0-10c77d82ec4f None None] MFA Rules not processed for user `75cae7faa6a64b90aa5398adc4288503`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:16.011715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-2b76a5f9-3287-46a4-86d0-10c77d82ec4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:16.186240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 826/1633] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:15 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:16.201577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a5f9-3287-46a4-86d0-10c77d82ec4f None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:16.203440 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-2b76a5f9-3287-46a4-86d0-10c77d82ec4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:16.203912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b3397-44b4-41cc-a66b-4f9e6985a324 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:16.216784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccb342-5c3b-4c02-95bc-62342fed9125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:16.217490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccb342-5c3b-4c02-95bc-62342fed9125 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:16.217944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccb342-5c3b-4c02-95bc-62342fed9125 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:16.218417 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccb342-5c3b-4c02-95bc-62342fed9125 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:16.219399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccb342-5c3b-4c02-95bc-62342fed9125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:16.221456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccb342-5c3b-4c02-95bc-62342fed9125 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:16.256884 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 808/1634] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:15 2021] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:16.267803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccb342-5c3b-4c02-95bc-62342fed9125 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:16.302235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccb342-5c3b-4c02-95bc-62342fed9125 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:16.326532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31537f-f3a1-4e9c-89c3-f0fc1ccdcddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:16.327759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31537f-f3a1-4e9c-89c3-f0fc1ccdcddb admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:16.328230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31537f-f3a1-4e9c-89c3-f0fc1ccdcddb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:16.328541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31537f-f3a1-4e9c-89c3-f0fc1ccdcddb admin admin] PATH_INFO: `/v3/projects/c79ef704804f424e9a2ec5b491670299/users/f434e90361dc4fd080b547e01a46b0c3/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:16.340255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a5f9-3287-46a4-86d0-10c77d82ec4f None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:16.583968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ab91f-dbdf-4fa1-8674-27d43d62ac48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:16.583968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ab91f-dbdf-4fa1-8674-27d43d62ac48 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:16.583968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ab91f-dbdf-4fa1-8674-27d43d62ac48 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:16.583968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ab91f-dbdf-4fa1-8674-27d43d62ac48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:16.592057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ab91f-dbdf-4fa1-8674-27d43d62ac48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:16.593537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31537f-f3a1-4e9c-89c3-f0fc1ccdcddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79ef704804f424e9a2ec5b491670299, user_id=f434e90361dc4fd080b547e01a46b0c3, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:16.593699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ab91f-dbdf-4fa1-8674-27d43d62ac48 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:16.593900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31537f-f3a1-4e9c-89c3-f0fc1ccdcddb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:16.594101 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 827/1635] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:16 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:16.594199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 809/1636] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:16 2021] PUT /identity/v3/projects/c79ef704804f424e9a2ec5b491670299/users/f434e90361dc4fd080b547e01a46b0c3/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:16.594276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ab91f-dbdf-4fa1-8674-27d43d62ac48 service nova] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:16.594276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ab91f-dbdf-4fa1-8674-27d43d62ac48 service nova] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:16.690986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2f1b-61d4-436f-926c-155204001989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:16.691843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2f1b-61d4-436f-926c-155204001989 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:16.696088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2f1b-61d4-436f-926c-155204001989 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:16.696088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2f1b-61d4-436f-926c-155204001989 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:16.696088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce2f1b-61d4-436f-926c-155204001989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:16.698594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce2f1b-61d4-436f-926c-155204001989 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:16.722338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 828/1637] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:16 2021] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:16.726323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31537f-f3a1-4e9c-89c3-f0fc1ccdcddb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:16.770839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31537f-f3a1-4e9c-89c3-f0fc1ccdcddb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:16.807012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dbcb9-d184-46c2-8e8d-3ff4c48edee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:16.808040 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dbcb9-d184-46c2-8e8d-3ff4c48edee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:16.809814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dbcb9-d184-46c2-8e8d-3ff4c48edee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:16.810140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dbcb9-d184-46c2-8e8d-3ff4c48edee3 admin admin] PATH_INFO: `/v3/projects/c79ef704804f424e9a2ec5b491670299/users/f434e90361dc4fd080b547e01a46b0c3/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:16.814486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dbcb9-d184-46c2-8e8d-3ff4c48edee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79ef704804f424e9a2ec5b491670299, user_id=f434e90361dc4fd080b547e01a46b0c3, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:16.821875 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dbcb9-d184-46c2-8e8d-3ff4c48edee3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:16.856609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 810/1638] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:16 2021] PUT /identity/v3/projects/c79ef704804f424e9a2ec5b491670299/users/f434e90361dc4fd080b547e01a46b0c3/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:16.977463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2f1b-61d4-436f-926c-155204001989 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:16.980848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-02ce2f1b-61d4-436f-926c-155204001989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:17.024956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2f1b-61d4-436f-926c-155204001989 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:17.182929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:17.183979 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:17.184405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:17.184942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] PATH_INFO: `/v3/projects/91e13035221547208d5bd56644941e87` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:17.187016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e13035221547208d5bd56644941e87)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:17.190531 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54756e9-8ea8-4ebd-81fd-3797f97e5bb2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:17.191055 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54756e9-8ea8-4ebd-81fd-3797f97e5bb2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:17.191530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54756e9-8ea8-4ebd-81fd-3797f97e5bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:17.193941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:17.288398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e54756e9-8ea8-4ebd-81fd-3797f97e5bb2 None None] MFA Rules not processed for user `d21dce70b6444f0a9c129ae8bc6fdb38`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:17.290978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e54756e9-8ea8-4ebd-81fd-3797f97e5bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:17.348307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e13035221547208d5bd56644941e87', 'request_id': 'req-5f61fc7a-beb3-4be5-824a-41c27b337318'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:17.361535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e13035221547208d5bd56644941e87', 'request_id': 'req-5f61fc7a-beb3-4be5-824a-41c27b337318'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:17.371578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e13035221547208d5bd56644941e87', 'request_id': 'req-5f61fc7a-beb3-4be5-824a-41c27b337318'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:17.425073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 811/1639] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:17 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:17.427363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecf339-02a0-481c-84e4-7859483ac40d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:17.427819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecf339-02a0-481c-84e4-7859483ac40d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:17.428245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecf339-02a0-481c-84e4-7859483ac40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:17.454363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-8cecf339-02a0-481c-84e4-7859483ac40d None None] MFA Rules not processed for user `d21dce70b6444f0a9c129ae8bc6fdb38`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:17.455867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8cecf339-02a0-481c-84e4-7859483ac40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:17.499937 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] The token cache is being invalidate because project 91e13035221547208d5bd56644941e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:17.500446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:17.501697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f61fc7a-beb3-4be5-824a-41c27b337318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:17.504654 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 829/1640] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:16 2021] DELETE /identity/v3/projects/91e13035221547208d5bd56644941e87 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:17.511794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ddaf0-b441-44f7-9094-31356553c5fc None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:17.512078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ddaf0-b441-44f7-9094-31356553c5fc None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:17.512566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ddaf0-b441-44f7-9094-31356553c5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:17.532305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 812/1641] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:17 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:17.534142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4e4ddaf0-b441-44f7-9094-31356553c5fc None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:17.535726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4e4ddaf0-b441-44f7-9094-31356553c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:17.545180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecf339-02a0-481c-84e4-7859483ac40d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:17.546777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8cecf339-02a0-481c-84e4-7859483ac40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:17.652410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 830/1642] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:17.661053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dd5a7-2d0a-4bf5-be81-7c086f515c3f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:17.662107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dd5a7-2d0a-4bf5-be81-7c086f515c3f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:17.662639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dd5a7-2d0a-4bf5-be81-7c086f515c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:17.702562 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4e8dd5a7-2d0a-4bf5-be81-7c086f515c3f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:17.704693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4e8dd5a7-2d0a-4bf5-be81-7c086f515c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:17.718221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 831/1643] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:17.720833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40c6c7-e401-43f0-841e-5bb22bbf4a6e None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:17.721280 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40c6c7-e401-43f0-841e-5bb22bbf4a6e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:17.722203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40c6c7-e401-43f0-841e-5bb22bbf4a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:17.730785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecf339-02a0-481c-84e4-7859483ac40d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:17.739306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f02a-2171-425f-8fa3-18b9f767a1d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:17.740016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f02a-2171-425f-8fa3-18b9f767a1d9 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:17.740306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f02a-2171-425f-8fa3-18b9f767a1d9 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:17.740624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f02a-2171-425f-8fa3-18b9f767a1d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:17.746826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-61f2f02a-2171-425f-8fa3-18b9f767a1d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:17.767486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2f02a-2171-425f-8fa3-18b9f767a1d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:17.770001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2f02a-2171-425f-8fa3-18b9f767a1d9 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:17.770962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-2f40c6c7-e401-43f0-841e-5bb22bbf4a6e None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:17.772400 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-2f40c6c7-e401-43f0-841e-5bb22bbf4a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:17.797307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 813/1644] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:17 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:17.798694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f02a-2171-425f-8fa3-18b9f767a1d9 service nova] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:17.814597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f02a-2171-425f-8fa3-18b9f767a1d9 service nova] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:17.819975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57af07-895e-4d5e-bbe4-f12c26a1912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:17.824777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57af07-895e-4d5e-bbe4-f12c26a1912f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:17.824777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57af07-895e-4d5e-bbe4-f12c26a1912f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:17.824777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57af07-895e-4d5e-bbe4-f12c26a1912f admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:17.824777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57af07-895e-4d5e-bbe4-f12c26a1912f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:17.824777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57af07-895e-4d5e-bbe4-f12c26a1912f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:17.826288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57af07-895e-4d5e-bbe4-f12c26a1912f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:17.839710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 814/1645] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:17.844680 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57af07-895e-4d5e-bbe4-f12c26a1912f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:17.865981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57af07-895e-4d5e-bbe4-f12c26a1912f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:17.873888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0f275-45f4-4370-8051-5fa0700b3b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:17.876539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f275-45f4-4370-8051-5fa0700b3b7d admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:17.876539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f275-45f4-4370-8051-5fa0700b3b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:17.876539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f275-45f4-4370-8051-5fa0700b3b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:17.876539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0f275-45f4-4370-8051-5fa0700b3b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:17.878274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0f275-45f4-4370-8051-5fa0700b3b7d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:17.908269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 832/1646] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:44:17 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:17.978137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 815/1647] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:17 2021] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:17.983017 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40c6c7-e401-43f0-841e-5bb22bbf4a6e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:18.023284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40c6c7-e401-43f0-841e-5bb22bbf4a6e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:18.118260 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff45d58-92b8-4c46-b91f-fc244d8ecf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:18.120541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45d58-92b8-4c46-b91f-fc244d8ecf1d admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:18.121010 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45d58-92b8-4c46-b91f-fc244d8ecf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:18.121322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45d58-92b8-4c46-b91f-fc244d8ecf1d admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:18.151589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff45d58-92b8-4c46-b91f-fc244d8ecf1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:18.151589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff45d58-92b8-4c46-b91f-fc244d8ecf1d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:18.508110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 833/1648] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:17 2021] POST /identity/v3/users => generated 295 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:18.511990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0f275-45f4-4370-8051-5fa0700b3b7d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:18.536065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff45d58-92b8-4c46-b91f-fc244d8ecf1d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:18.538011 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6ff45d58-92b8-4c46-b91f-fc244d8ecf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:18.545814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0f275-45f4-4370-8051-5fa0700b3b7d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:18.561132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942ffed-686a-48cc-b244-9d2d8b66e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:18.561967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942ffed-686a-48cc-b244-9d2d8b66e2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:18.562331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942ffed-686a-48cc-b244-9d2d8b66e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:18.562850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942ffed-686a-48cc-b244-9d2d8b66e2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:18.565240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942ffed-686a-48cc-b244-9d2d8b66e2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:18.569674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942ffed-686a-48cc-b244-9d2d8b66e2e2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:18.590975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 816/1649] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:18 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:18.602667 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942ffed-686a-48cc-b244-9d2d8b66e2e2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:18.621821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942ffed-686a-48cc-b244-9d2d8b66e2e2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:18.636237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae6dd9-5629-4141-b3bb-77d03487d85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:18.637563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae6dd9-5629-4141-b3bb-77d03487d85f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:18.640158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae6dd9-5629-4141-b3bb-77d03487d85f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:18.640659 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae6dd9-5629-4141-b3bb-77d03487d85f admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:18.644165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae6dd9-5629-4141-b3bb-77d03487d85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:18.648337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae6dd9-5629-4141-b3bb-77d03487d85f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:18.694025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 817/1650] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:18 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:18.695047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae6dd9-5629-4141-b3bb-77d03487d85f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:18.723209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae6dd9-5629-4141-b3bb-77d03487d85f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:18.742355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3feae-3604-40d1-aeca-131965ee4970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:18.744100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3feae-3604-40d1-aeca-131965ee4970 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:18.744873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3feae-3604-40d1-aeca-131965ee4970 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:18.745376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3feae-3604-40d1-aeca-131965ee4970 admin admin] PATH_INFO: `/v3/projects/50f0838070e84c1baf7fe0c1891cb720/users/fa8a5bf909414337b5a9a0d75bd310be/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:18.768977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3feae-3604-40d1-aeca-131965ee4970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f0838070e84c1baf7fe0c1891cb720, user_id=fa8a5bf909414337b5a9a0d75bd310be, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:18.772119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff45d58-92b8-4c46-b91f-fc244d8ecf1d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:18.773197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3feae-3604-40d1-aeca-131965ee4970 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:18.795852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c7bfd-9da5-432a-9c04-b87979ab0c6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:18.798267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7bfd-9da5-432a-9c04-b87979ab0c6d service swift] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:18.798267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7bfd-9da5-432a-9c04-b87979ab0c6d service swift] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:18.798267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7bfd-9da5-432a-9c04-b87979ab0c6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:18.922337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 818/1651] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:18 2021] PUT /identity/v3/projects/50f0838070e84c1baf7fe0c1891cb720/users/fa8a5bf909414337b5a9a0d75bd310be/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:18.953296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c7bfd-9da5-432a-9c04-b87979ab0c6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:18.954970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c7bfd-9da5-432a-9c04-b87979ab0c6d service swift] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:18.979169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 834/1652] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:44:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:18.989179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6766d-0683-4d1e-9394-0a30e9b9a1d4 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:18.989792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6766d-0683-4d1e-9394-0a30e9b9a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:18.990370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6766d-0683-4d1e-9394-0a30e9b9a1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:19.033102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d7a6766d-0683-4d1e-9394-0a30e9b9a1d4 None None] MFA Rules not processed for user `fa8a5bf909414337b5a9a0d75bd310be`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:19.034825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d7a6766d-0683-4d1e-9394-0a30e9b9a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:19.215319 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 819/1653] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:18 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:19.215601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c7bfd-9da5-432a-9c04-b87979ab0c6d service swift] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:19.229070 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c7bfd-9da5-432a-9c04-b87979ab0c6d service swift] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:19.373697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db4be-850b-4642-8a10-be19673429df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:19.374640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db4be-850b-4642-8a10-be19673429df admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:19.377671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db4be-850b-4642-8a10-be19673429df admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:19.377671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db4be-850b-4642-8a10-be19673429df admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:19.377671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0db4be-850b-4642-8a10-be19673429df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:19.378367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0db4be-850b-4642-8a10-be19673429df admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:19.511229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 835/1654] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:19 2021] POST /identity/v3/projects => generated 389 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:19.512939 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6766d-0683-4d1e-9394-0a30e9b9a1d4 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:19.532937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6766d-0683-4d1e-9394-0a30e9b9a1d4 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:19.773424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def85efb-e2f0-4fbd-a357-1a0b93b09848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:19.774755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def85efb-e2f0-4fbd-a357-1a0b93b09848 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:19.775331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def85efb-e2f0-4fbd-a357-1a0b93b09848 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:19.775801 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def85efb-e2f0-4fbd-a357-1a0b93b09848 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:19.776817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def85efb-e2f0-4fbd-a357-1a0b93b09848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:19.779782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def85efb-e2f0-4fbd-a357-1a0b93b09848 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:19.808167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db4be-850b-4642-8a10-be19673429df admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:19.810131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-cf0db4be-850b-4642-8a10-be19673429df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:19.861809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db4be-850b-4642-8a10-be19673429df admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:19.881145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:19.887364 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:19.890536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:19.891244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] PATH_INFO: `/v3/users/01e9ef5adcdd41a586007c929e2a3970` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:19.895026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e9ef5adcdd41a586007c929e2a3970)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:19.900232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:19.936299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 820/1655] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:19 2021] POST /identity/v3/users => generated 301 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:19.941044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def85efb-e2f0-4fbd-a357-1a0b93b09848 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:19.977055 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def85efb-e2f0-4fbd-a357-1a0b93b09848 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:20.005310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae406531-8caf-444a-8e13-ab25b0646b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:20.006610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae406531-8caf-444a-8e13-ab25b0646b2a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:20.021200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae406531-8caf-444a-8e13-ab25b0646b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:20.021200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae406531-8caf-444a-8e13-ab25b0646b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:20.021200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae406531-8caf-444a-8e13-ab25b0646b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:20.024126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae406531-8caf-444a-8e13-ab25b0646b2a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:20.046474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 821/1656] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:19 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:20.052000 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae406531-8caf-444a-8e13-ab25b0646b2a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:20.111204 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae406531-8caf-444a-8e13-ab25b0646b2a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:20.176523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbd8a6-1608-4978-88a1-0ec7a7fe3947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:20.177451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbd8a6-1608-4978-88a1-0ec7a7fe3947 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:20.177728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbd8a6-1608-4978-88a1-0ec7a7fe3947 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:20.178004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbd8a6-1608-4978-88a1-0ec7a7fe3947 admin admin] PATH_INFO: `/v3/projects/4d3123c86a8145bf83c17bc2329250d5/users/4a63250158ab49f2be5b10046788ca43/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:20.263288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbd8a6-1608-4978-88a1-0ec7a7fe3947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3123c86a8145bf83c17bc2329250d5, user_id=4a63250158ab49f2be5b10046788ca43, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:20.269049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbd8a6-1608-4978-88a1-0ec7a7fe3947 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:20.282141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e9ef5adcdd41a586007c929e2a3970'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:20.323883 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e9ef5adcdd41a586007c929e2a3970'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:20.327216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e9ef5adcdd41a586007c929e2a3970'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:20.350640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e9ef5adcdd41a586007c929e2a3970'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:20.385164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 822/1657] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:20 2021] PUT /identity/v3/projects/4d3123c86a8145bf83c17bc2329250d5/users/4a63250158ab49f2be5b10046788ca43/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:20.387091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc01a6-de27-4d73-ab4f-f2602d9f9627 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:20.387686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc01a6-de27-4d73-ab4f-f2602d9f9627 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:20.388184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc01a6-de27-4d73-ab4f-f2602d9f9627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:20.442481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e9ef5adcdd41a586007c929e2a3970'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:20.453653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 836/1658] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:19 2021] DELETE /identity/v3/users/01e9ef5adcdd41a586007c929e2a3970 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:20.454661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:20.459883 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:20.464043 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0dfc01a6-de27-4d73-ab4f-f2602d9f9627 None None] MFA Rules not processed for user `d21dce70b6444f0a9c129ae8bc6fdb38`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:20.465322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0dfc01a6-de27-4d73-ab4f-f2602d9f9627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:20.717723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 823/1659] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:20 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:20.721039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ec1da-c392-4c8e-b707-ae254ff63ce5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:20.723813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ec1da-c392-4c8e-b707-ae254ff63ce5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:20.725138 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ec1da-c392-4c8e-b707-ae254ff63ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:20.734416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d44f1-3115-400e-b28e-2604df8c7cdc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:20.758093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa81d9-60a7-4dc3-8bf7-bc5111696397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:20.759984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa81d9-60a7-4dc3-8bf7-bc5111696397 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:20.760280 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa81d9-60a7-4dc3-8bf7-bc5111696397 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:20.762468 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa81d9-60a7-4dc3-8bf7-bc5111696397 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:20.764140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa81d9-60a7-4dc3-8bf7-bc5111696397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:20.774143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa81d9-60a7-4dc3-8bf7-bc5111696397 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:20.774337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-792ec1da-c392-4c8e-b707-ae254ff63ce5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:20.774337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-792ec1da-c392-4c8e-b707-ae254ff63ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:20.805724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 824/1660] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:20.814961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 837/1661] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:20 2021] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:20.822880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ec1da-c392-4c8e-b707-ae254ff63ce5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:20.866116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa81d9-60a7-4dc3-8bf7-bc5111696397 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:20.866116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c8fa81d9-60a7-4dc3-8bf7-bc5111696397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:20.867112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ec1da-c392-4c8e-b707-ae254ff63ce5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:20.899646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64482f43-a452-4561-b3d1-68794fc2ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:20.900615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482f43-a452-4561-b3d1-68794fc2ec9b admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:20.909577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482f43-a452-4561-b3d1-68794fc2ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:20.909577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482f43-a452-4561-b3d1-68794fc2ec9b admin admin] PATH_INFO: `/v3/projects/4d3123c86a8145bf83c17bc2329250d5/users/4a63250158ab49f2be5b10046788ca43/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:20.919353 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64482f43-a452-4561-b3d1-68794fc2ec9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3123c86a8145bf83c17bc2329250d5, user_id=4a63250158ab49f2be5b10046788ca43, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:20.922201 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64482f43-a452-4561-b3d1-68794fc2ec9b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:21.011349 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 825/1662] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:20 2021] PUT /identity/v3/projects/4d3123c86a8145bf83c17bc2329250d5/users/4a63250158ab49f2be5b10046788ca43/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:21.024405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3170a-643c-47ce-baf1-24a4df4895e2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:21.024657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3170a-643c-47ce-baf1-24a4df4895e2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:21.024898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3170a-643c-47ce-baf1-24a4df4895e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:21.113912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2eb3170a-643c-47ce-baf1-24a4df4895e2 None None] MFA Rules not processed for user `4a63250158ab49f2be5b10046788ca43`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:21.115952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2eb3170a-643c-47ce-baf1-24a4df4895e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:21.151313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa81d9-60a7-4dc3-8bf7-bc5111696397 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:21.306250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 826/1663] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:21 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:21.317474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3170a-643c-47ce-baf1-24a4df4895e2 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:21.330946 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2eb3170a-643c-47ce-baf1-24a4df4895e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:21.344602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594ec1-64c6-441d-8271-bec90659204c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:21.345610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594ec1-64c6-441d-8271-bec90659204c service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:21.345903 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594ec1-64c6-441d-8271-bec90659204c service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:21.346184 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594ec1-64c6-441d-8271-bec90659204c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:21.490772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68594ec1-64c6-441d-8271-bec90659204c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:21.490772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68594ec1-64c6-441d-8271-bec90659204c service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:21.515346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 838/1664] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:21.516721 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3170a-643c-47ce-baf1-24a4df4895e2 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:21.518724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594ec1-64c6-441d-8271-bec90659204c service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:21.522583 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:21.523488 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:21.523773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:21.524050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] PATH_INFO: `/v3/users/e6fee3e5dec649a99e67ae051b37002d` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:21.525532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6fee3e5dec649a99e67ae051b37002d)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:21.525788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-68594ec1-64c6-441d-8271-bec90659204c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:21.527609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:21.634409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594ec1-64c6-441d-8271-bec90659204c service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:21.642269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5a3c9-7171-4a5f-a051-e11391b97ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:21.643543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5a3c9-7171-4a5f-a051-e11391b97ede service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:21.644121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5a3c9-7171-4a5f-a051-e11391b97ede service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:21.644744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5a3c9-7171-4a5f-a051-e11391b97ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:21.659843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5a3c9-7171-4a5f-a051-e11391b97ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:21.661801 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5a3c9-7171-4a5f-a051-e11391b97ede service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:21.678120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 839/1665] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:21 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:21.977827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6fee3e5dec649a99e67ae051b37002d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:21.978613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6fee3e5dec649a99e67ae051b37002d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:21.979223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6fee3e5dec649a99e67ae051b37002d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:22.020760 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6fee3e5dec649a99e67ae051b37002d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:22.041012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef7dd-9502-4ef8-ac41-59cc7cb08f99 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:22.041477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef7dd-9502-4ef8-ac41-59cc7cb08f99 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:22.041909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef7dd-9502-4ef8-ac41-59cc7cb08f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:22.085966 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c9f468b1-ce85-4a14-9af3-1ef729065876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6fee3e5dec649a99e67ae051b37002d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:22.095122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b35ef7dd-9502-4ef8-ac41-59cc7cb08f99 None None] MFA Rules not processed for user `f434e90361dc4fd080b547e01a46b0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:22.097123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b35ef7dd-9502-4ef8-ac41-59cc7cb08f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:22.116583 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 827/1666] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:21 2021] DELETE /identity/v3/users/e6fee3e5dec649a99e67ae051b37002d => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:22.122468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f60ee4-18ea-4de7-a6e5-6b361cf9b5c2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:22.123154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f60ee4-18ea-4de7-a6e5-6b361cf9b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:22.125557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f60ee4-18ea-4de7-a6e5-6b361cf9b5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:22.184876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-f4f60ee4-18ea-4de7-a6e5-6b361cf9b5c2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:22.196736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f4f60ee4-18ea-4de7-a6e5-6b361cf9b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:22.378686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 840/1667] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:22 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:22.393839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 828/1668] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:22.509657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ef7dd-9502-4ef8-ac41-59cc7cb08f99 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:22.511454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b35ef7dd-9502-4ef8-ac41-59cc7cb08f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:22.532674 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ef7dd-9502-4ef8-ac41-59cc7cb08f99 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:22.538383 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:22.539893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:22.540527 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:22.541035 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] PATH_INFO: `/v3/users/fa8a5bf909414337b5a9a0d75bd310be` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:22.542915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8a5bf909414337b5a9a0d75bd310be)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:22.546276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:22.753988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f60ee4-18ea-4de7-a6e5-6b361cf9b5c2 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:22.757388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f4f60ee4-18ea-4de7-a6e5-6b361cf9b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:22.791984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8a5bf909414337b5a9a0d75bd310be'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:22.851530 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8a5bf909414337b5a9a0d75bd310be'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:22.856917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8a5bf909414337b5a9a0d75bd310be'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:22.907994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8a5bf909414337b5a9a0d75bd310be'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:22.957551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f60ee4-18ea-4de7-a6e5-6b361cf9b5c2 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:22.979123 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca48113-b64e-4c69-91a8-5aea601cec18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:22.980476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca48113-b64e-4c69-91a8-5aea601cec18 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:22.981133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca48113-b64e-4c69-91a8-5aea601cec18 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:22.984541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca48113-b64e-4c69-91a8-5aea601cec18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:23.018694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca48113-b64e-4c69-91a8-5aea601cec18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:23.023949 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca48113-b64e-4c69-91a8-5aea601cec18 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:23.026896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e152cf98-8a83-45ff-aba6-a557587d71a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8a5bf909414337b5a9a0d75bd310be'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:23.036317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 841/1669] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:22 2021] DELETE /identity/v3/users/fa8a5bf909414337b5a9a0d75bd310be => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:23.038058 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37032f5-1d15-463a-99fb-93971d528c11 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:23.038470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37032f5-1d15-463a-99fb-93971d528c11 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:23.038822 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37032f5-1d15-463a-99fb-93971d528c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:23.065842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 829/1670] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:23.073829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5839a4-05ca-4e8c-94a7-defa232dbb59 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:23.074119 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5839a4-05ca-4e8c-94a7-defa232dbb59 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:23.074573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5839a4-05ca-4e8c-94a7-defa232dbb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:23.096305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d37032f5-1d15-463a-99fb-93971d528c11 None None] MFA Rules not processed for user `a95d2eadd8c7455bb70477e4522c74c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:23.097589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d37032f5-1d15-463a-99fb-93971d528c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:23.125902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-8a5839a4-05ca-4e8c-94a7-defa232dbb59 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:23.129648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8a5839a4-05ca-4e8c-94a7-defa232dbb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:23.170851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 842/1671] 10.222.0.43 () {58 vars in 1016 bytes} [Fri Aug 27 04:44:23 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:23.209526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37032f5-1d15-463a-99fb-93971d528c11 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:23.218753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d37032f5-1d15-463a-99fb-93971d528c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:23.327438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 830/1672] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:23.329150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5839a4-05ca-4e8c-94a7-defa232dbb59 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:23.362223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8a5839a4-05ca-4e8c-94a7-defa232dbb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:23.385485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5839a4-05ca-4e8c-94a7-defa232dbb59 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:23.397978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772527d-5a2a-49aa-8148-3cd133411b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:23.399492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772527d-5a2a-49aa-8148-3cd133411b71 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:23.400059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772527d-5a2a-49aa-8148-3cd133411b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:23.400659 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772527d-5a2a-49aa-8148-3cd133411b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:23.421706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772527d-5a2a-49aa-8148-3cd133411b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:23.423793 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772527d-5a2a-49aa-8148-3cd133411b71 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:23.433767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 831/1673] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:23 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:23.490014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772527d-5a2a-49aa-8148-3cd133411b71 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:23.490014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772527d-5a2a-49aa-8148-3cd133411b71 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:23.490014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585331e7-49ae-4425-9db2-fb8658bc211a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:23.490014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585331e7-49ae-4425-9db2-fb8658bc211a service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:23.492270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585331e7-49ae-4425-9db2-fb8658bc211a service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:23.492270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585331e7-49ae-4425-9db2-fb8658bc211a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:23.492270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585331e7-49ae-4425-9db2-fb8658bc211a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:23.492270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585331e7-49ae-4425-9db2-fb8658bc211a service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:23.506664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37032f5-1d15-463a-99fb-93971d528c11 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:23.514906 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:23.517261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:23.517703 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:23.518132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] PATH_INFO: `/v3/projects/3d4cde4815bf4ba0b7081d5f92ff5b43` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:23.520565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4cde4815bf4ba0b7081d5f92ff5b43)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:23.524394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:23.544968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 832/1674] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:23 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:23.545926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585331e7-49ae-4425-9db2-fb8658bc211a service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:23.618093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585331e7-49ae-4425-9db2-fb8658bc211a service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:23.627574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcee4c5-5dce-43a5-8b48-1eebd29e5751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:23.628320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcee4c5-5dce-43a5-8b48-1eebd29e5751 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:23.628660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcee4c5-5dce-43a5-8b48-1eebd29e5751 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:23.628940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcee4c5-5dce-43a5-8b48-1eebd29e5751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:23.658812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcee4c5-5dce-43a5-8b48-1eebd29e5751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:23.663900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcee4c5-5dce-43a5-8b48-1eebd29e5751 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:23.692155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 833/1675] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:23.765950 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4cde4815bf4ba0b7081d5f92ff5b43', 'request_id': 'req-ddb5e280-6648-4831-aa3f-52fe82291348'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:23.801718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4cde4815bf4ba0b7081d5f92ff5b43', 'request_id': 'req-ddb5e280-6648-4831-aa3f-52fe82291348'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:23.822262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4cde4815bf4ba0b7081d5f92ff5b43', 'request_id': 'req-ddb5e280-6648-4831-aa3f-52fe82291348'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:23.936776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] The token cache is being invalidate because project 3d4cde4815bf4ba0b7081d5f92ff5b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:23.936776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:23.937434 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ddb5e280-6648-4831-aa3f-52fe82291348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:23.942736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 843/1676] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:23 2021] DELETE /identity/v3/projects/3d4cde4815bf4ba0b7081d5f92ff5b43 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:23.948405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bd312-33a5-4e9c-9f05-6a54384f7ff2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:23.948809 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bd312-33a5-4e9c-9f05-6a54384f7ff2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:23.949179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bd312-33a5-4e9c-9f05-6a54384f7ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:24.018189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-459bd312-33a5-4e9c-9f05-6a54384f7ff2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:24.026877 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-459bd312-33a5-4e9c-9f05-6a54384f7ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:24.268924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 834/1677] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:24.272211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75464c-5d99-479f-bab8-ca13ec8f48d2 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:24.272536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75464c-5d99-479f-bab8-ca13ec8f48d2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:24.277033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75464c-5d99-479f-bab8-ca13ec8f48d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:24.328842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-bd75464c-5d99-479f-bab8-ca13ec8f48d2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:24.334655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-bd75464c-5d99-479f-bab8-ca13ec8f48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:24.365404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 844/1678] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:24.372539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bd312-33a5-4e9c-9f05-6a54384f7ff2 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:24.385292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bd312-33a5-4e9c-9f05-6a54384f7ff2 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:24.395827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3b229-d2a2-409c-b2a7-68b1fa51b5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:24.397074 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3b229-d2a2-409c-b2a7-68b1fa51b5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:24.397384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3b229-d2a2-409c-b2a7-68b1fa51b5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:24.397660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3b229-d2a2-409c-b2a7-68b1fa51b5d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:24.398451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3b229-d2a2-409c-b2a7-68b1fa51b5d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:24.398768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3b229-d2a2-409c-b2a7-68b1fa51b5d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:24.400703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3b229-d2a2-409c-b2a7-68b1fa51b5d0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:24.422097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 835/1679] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:44:24.423900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75464c-5d99-479f-bab8-ca13ec8f48d2 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:24.440582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75464c-5d99-479f-bab8-ca13ec8f48d2 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:24.447828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6852a6-8e53-4c25-8bc7-078fa878ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:24.448648 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6852a6-8e53-4c25-8bc7-078fa878ca5d admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:24.448923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6852a6-8e53-4c25-8bc7-078fa878ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:24.449400 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6852a6-8e53-4c25-8bc7-078fa878ca5d admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:24.450119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6852a6-8e53-4c25-8bc7-078fa878ca5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:24.453403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6852a6-8e53-4c25-8bc7-078fa878ca5d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:24.615531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 845/1680] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:24 2021] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:24.617696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3b229-d2a2-409c-b2a7-68b1fa51b5d0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:24.633582 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3b229-d2a2-409c-b2a7-68b1fa51b5d0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:24.818753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4239e5-a19a-4c65-af25-3fe014b91f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:24.819525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4239e5-a19a-4c65-af25-3fe014b91f79 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:24.820108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4239e5-a19a-4c65-af25-3fe014b91f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:24.820566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4239e5-a19a-4c65-af25-3fe014b91f79 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:24.822698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4239e5-a19a-4c65-af25-3fe014b91f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:24.827024 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4239e5-a19a-4c65-af25-3fe014b91f79 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:24.968494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 836/1681] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:24 2021] POST /identity/v3/users => generated 287 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:24.972661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6852a6-8e53-4c25-8bc7-078fa878ca5d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:25.011705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6852a6-8e53-4c25-8bc7-078fa878ca5d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:25.021300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dd929-e900-43ce-a530-74fd563c04c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:25.022695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dd929-e900-43ce-a530-74fd563c04c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:25.022695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dd929-e900-43ce-a530-74fd563c04c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:25.022695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dd929-e900-43ce-a530-74fd563c04c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:25.023318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174dd929-e900-43ce-a530-74fd563c04c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:25.024945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174dd929-e900-43ce-a530-74fd563c04c5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:25.052623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 846/1682] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:24 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:25.056419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4239e5-a19a-4c65-af25-3fe014b91f79 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:25.085098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4239e5-a19a-4c65-af25-3fe014b91f79 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:25.098738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c7499-8d1c-4714-a5cb-69c88de7c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:25.099335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c7499-8d1c-4714-a5cb-69c88de7c58a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:25.099663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c7499-8d1c-4714-a5cb-69c88de7c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:25.099964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c7499-8d1c-4714-a5cb-69c88de7c58a admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:25.100867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c7499-8d1c-4714-a5cb-69c88de7c58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:25.105640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c7499-8d1c-4714-a5cb-69c88de7c58a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:25.141089 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 837/1683] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:25 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:25.145502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dd929-e900-43ce-a530-74fd563c04c5 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:25.158014 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dd929-e900-43ce-a530-74fd563c04c5 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:25.163546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd3a72-f3bc-4a43-a265-8430c59dc654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:25.164499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3a72-f3bc-4a43-a265-8430c59dc654 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:25.164860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3a72-f3bc-4a43-a265-8430c59dc654 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:25.165168 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3a72-f3bc-4a43-a265-8430c59dc654 admin admin] PATH_INFO: `/v3/projects/cf01048877b74687a9aef60d7dc38218/users/c301dcb237124b1eb153630c4d81c751/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:25.207247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd3a72-f3bc-4a43-a265-8430c59dc654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf01048877b74687a9aef60d7dc38218, user_id=c301dcb237124b1eb153630c4d81c751, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:25.211226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd3a72-f3bc-4a43-a265-8430c59dc654 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:25.395358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 847/1684] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:25 2021] PUT /identity/v3/projects/cf01048877b74687a9aef60d7dc38218/users/c301dcb237124b1eb153630c4d81c751/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:25.406608 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7c859-922e-4f05-aea9-01796e8af8af None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:25.406608 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7c859-922e-4f05-aea9-01796e8af8af None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:25.407074 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7c859-922e-4f05-aea9-01796e8af8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:25.467529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b7c7c859-922e-4f05-aea9-01796e8af8af None None] MFA Rules not processed for user `c301dcb237124b1eb153630c4d81c751`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:25.467529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b7c7c859-922e-4f05-aea9-01796e8af8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:25.637455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 838/1685] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:25 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:25.720710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd3a72-f3bc-4a43-a265-8430c59dc654 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:25.722878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d3bd3a72-f3bc-4a43-a265-8430c59dc654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:25.878813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd3a72-f3bc-4a43-a265-8430c59dc654 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:25.885351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67a678-c953-4253-980b-2faffc6af413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:25.886371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67a678-c953-4253-980b-2faffc6af413 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:25.886859 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67a678-c953-4253-980b-2faffc6af413 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:25.887340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67a678-c953-4253-980b-2faffc6af413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:25.917013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67a678-c953-4253-980b-2faffc6af413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:25.917013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67a678-c953-4253-980b-2faffc6af413 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:25.949893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 848/1686] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:25 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:26.305266 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7c859-922e-4f05-aea9-01796e8af8af None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:26.307446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b7c7c859-922e-4f05-aea9-01796e8af8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:26.338397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67a678-c953-4253-980b-2faffc6af413 service nova] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:26.421083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7c859-922e-4f05-aea9-01796e8af8af None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:26.427396 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:26.428580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:26.428580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:26.428876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] PATH_INFO: `/v3/projects/a03ac913ba9947afb4a966b6191920cf` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:26.430424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03ac913ba9947afb4a966b6191920cf)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:26.433563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:26.499043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67a678-c953-4253-980b-2faffc6af413 service nova] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:26.519403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:26.520456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:26.525338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:26.525338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] PATH_INFO: `/v3/users/c301dcb237124b1eb153630c4d81c751` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:26.525338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c301dcb237124b1eb153630c4d81c751)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:26.525338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:27.043325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03ac913ba9947afb4a966b6191920cf', 'request_id': 'req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:27.572733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03ac913ba9947afb4a966b6191920cf', 'request_id': 'req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:27.582003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03ac913ba9947afb4a966b6191920cf', 'request_id': 'req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:27.593766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c301dcb237124b1eb153630c4d81c751'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:27.609271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] The token cache is being invalidate because project a03ac913ba9947afb4a966b6191920cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:27.609652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:27.611203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3c0663e8-ac96-41bf-af3c-f6e2ed0eeb98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:27.613996 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 839/1687] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:26 2021] DELETE /identity/v3/projects/a03ac913ba9947afb4a966b6191920cf => generated 0 bytes in 1309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:27.616166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11cce6-b74f-49d5-9243-06b20c939a84 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:27.616723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11cce6-b74f-49d5-9243-06b20c939a84 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:27.617602 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11cce6-b74f-49d5-9243-06b20c939a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:27.630884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c301dcb237124b1eb153630c4d81c751'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:27.632167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c301dcb237124b1eb153630c4d81c751'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:27.646152 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c301dcb237124b1eb153630c4d81c751'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:27.650964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7c11cce6-b74f-49d5-9243-06b20c939a84 None None] MFA Rules not processed for user `75cae7faa6a64b90aa5398adc4288503`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:27.652207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7c11cce6-b74f-49d5-9243-06b20c939a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:27.738355 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c301dcb237124b1eb153630c4d81c751'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:27.743761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 840/1688] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:27 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:27.754550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11cce6-b74f-49d5-9243-06b20c939a84 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:27.754550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7c11cce6-b74f-49d5-9243-06b20c939a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:27.758373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 849/1689] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:26 2021] DELETE /identity/v3/users/c301dcb237124b1eb153630c4d81c751 => generated 0 bytes in 1417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:27.761290 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:27.764495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:28.017834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11cce6-b74f-49d5-9243-06b20c939a84 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:28.017834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:28.017834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:28.017834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:28.019971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] PATH_INFO: `/v3/users/f466466c3d944b0582c3d9bad2bed447` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:28.019971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f466466c3d944b0582c3d9bad2bed447)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:28.019971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:28.020756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa52a9-8984-4e6f-a044-f2a9e51b3e09 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:28.020756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:28.020756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:28.020756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:28.021376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] PATH_INFO: `/v3/projects/50f0838070e84c1baf7fe0c1891cb720` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:28.021376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f0838070e84c1baf7fe0c1891cb720)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:28.021376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:28.672015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f466466c3d944b0582c3d9bad2bed447'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:28.673699 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f466466c3d944b0582c3d9bad2bed447'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:28.676371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f466466c3d944b0582c3d9bad2bed447'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:28.681113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f0838070e84c1baf7fe0c1891cb720', 'request_id': 'req-29156759-6939-445a-95a3-a0f622ee61ef'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:28.694560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f0838070e84c1baf7fe0c1891cb720', 'request_id': 'req-29156759-6939-445a-95a3-a0f622ee61ef'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:28.706385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f466466c3d944b0582c3d9bad2bed447'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:28.709871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f0838070e84c1baf7fe0c1891cb720', 'request_id': 'req-29156759-6939-445a-95a3-a0f622ee61ef'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:28.799277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1ab70e13-d5f8-470f-9c70-900df08e2854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f466466c3d944b0582c3d9bad2bed447'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:28.822444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 841/1690] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:27 2021] DELETE /identity/v3/users/f466466c3d944b0582c3d9bad2bed447 => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:28.826997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8537e1-a48e-4a14-8f1c-5d6491b03899 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:28.828998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8537e1-a48e-4a14-8f1c-5d6491b03899 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:28.829518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8537e1-a48e-4a14-8f1c-5d6491b03899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:28.874466 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-ba8537e1-a48e-4a14-8f1c-5d6491b03899 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:28.877219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ba8537e1-a48e-4a14-8f1c-5d6491b03899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:28.880134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] The token cache is being invalidate because project 50f0838070e84c1baf7fe0c1891cb720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:28.880491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:28.887347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-29156759-6939-445a-95a3-a0f622ee61ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:28.892542 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 850/1691] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:27 2021] DELETE /identity/v3/projects/50f0838070e84c1baf7fe0c1891cb720 => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:28.894397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c132c41-0790-4d45-b2d6-13dd78b393f1 None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:28.894689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c132c41-0790-4d45-b2d6-13dd78b393f1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:28.897226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c132c41-0790-4d45-b2d6-13dd78b393f1 None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:28.903527 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 851/1692] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 04:44:28 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:44:28.905886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c132c41-0790-4d45-b2d6-13dd78b393f1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:28.922381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1c132c41-0790-4d45-b2d6-13dd78b393f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:29.018108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 842/1693] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:29.230496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8537e1-a48e-4a14-8f1c-5d6491b03899 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:29.230496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ba8537e1-a48e-4a14-8f1c-5d6491b03899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:29.230496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8537e1-a48e-4a14-8f1c-5d6491b03899 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:29.232535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:29.232535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:29.232535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:29.232535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] PATH_INFO: `/v3/users/4a63250158ab49f2be5b10046788ca43` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:29.233128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a63250158ab49f2be5b10046788ca43)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:29.233128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:29.233257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c132c41-0790-4d45-b2d6-13dd78b393f1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:29.233257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:29.233257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:29.233257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:29.233866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] PATH_INFO: `/v3/users/8e449e285a7a43d6a58f335ca4ee90ee` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:29.233866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e449e285a7a43d6a58f335ca4ee90ee)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:29.233866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:29.785906 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e449e285a7a43d6a58f335ca4ee90ee'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:29.798732 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e449e285a7a43d6a58f335ca4ee90ee'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:29.799758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e449e285a7a43d6a58f335ca4ee90ee'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:29.808195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e449e285a7a43d6a58f335ca4ee90ee'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:29.958416 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a63250158ab49f2be5b10046788ca43'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:29.959124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a63250158ab49f2be5b10046788ca43'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:29.959682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a63250158ab49f2be5b10046788ca43'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:29.998557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a63250158ab49f2be5b10046788ca43'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:30.162607 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4a6b862e-f319-4f4b-a08e-1bb3af8964b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e449e285a7a43d6a58f335ca4ee90ee'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:30.170386 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 852/1694] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:28 2021] DELETE /identity/v3/users/8e449e285a7a43d6a58f335ca4ee90ee => generated 0 bytes in 1266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:30.171863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad26fb6-ea5e-47a5-a2fb-ec80eba0457b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:30.172150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad26fb6-ea5e-47a5-a2fb-ec80eba0457b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:30.172470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad26fb6-ea5e-47a5-a2fb-ec80eba0457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:30.193760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-bad26fb6-ea5e-47a5-a2fb-ec80eba0457b None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:30.195535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-bad26fb6-ea5e-47a5-a2fb-ec80eba0457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:30.266207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a63250158ab49f2be5b10046788ca43'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:30.301618 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 853/1696] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 04:44:30 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:30.302535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad26fb6-ea5e-47a5-a2fb-ec80eba0457b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:30.303939 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-bad26fb6-ea5e-47a5-a2fb-ec80eba0457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:30.309551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 843/1696] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:29 2021] DELETE /identity/v3/users/4a63250158ab49f2be5b10046788ca43 => generated 0 bytes in 1281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:30.311153 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:30.312688 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:30.404529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad26fb6-ea5e-47a5-a2fb-ec80eba0457b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:30.465995 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586b497-a667-402a-bdf9-40a051286e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:30.466861 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586b497-a667-402a-bdf9-40a051286e63 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:30.467150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586b497-a667-402a-bdf9-40a051286e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:30.467420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586b497-a667-402a-bdf9-40a051286e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:30.469665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8a083-2277-44e1-b3b8-0b3d098b51a2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:30.489098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e586b497-a667-402a-bdf9-40a051286e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:30.498586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:30.507541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:30.510907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:30.511223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] PATH_INFO: `/v3/projects/98e787aad6ec47739695c348b8222470` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:30.513927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98e787aad6ec47739695c348b8222470)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:30.518666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586b497-a667-402a-bdf9-40a051286e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:30.521297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586b497-a667-402a-bdf9-40a051286e63 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:30.524430 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:30.530676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 854/1697] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:30.531523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586b497-a667-402a-bdf9-40a051286e63 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:30.532973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e586b497-a667-402a-bdf9-40a051286e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:30.643941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586b497-a667-402a-bdf9-40a051286e63 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:30.660287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594aead9-f90f-4620-9f9d-d98ce78a7586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:30.662211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aead9-f90f-4620-9f9d-d98ce78a7586 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:30.662516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aead9-f90f-4620-9f9d-d98ce78a7586 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:30.663882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aead9-f90f-4620-9f9d-d98ce78a7586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:30.682638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594aead9-f90f-4620-9f9d-d98ce78a7586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:30.684443 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594aead9-f90f-4620-9f9d-d98ce78a7586 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:30.709154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 855/1698] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:30.735346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98e787aad6ec47739695c348b8222470', 'request_id': 'req-2469300f-148e-42ab-a78d-178b187991f2'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:30.807041 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98e787aad6ec47739695c348b8222470', 'request_id': 'req-2469300f-148e-42ab-a78d-178b187991f2'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:30.815221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98e787aad6ec47739695c348b8222470', 'request_id': 'req-2469300f-148e-42ab-a78d-178b187991f2'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:30.837124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] The token cache is being invalidate because project 98e787aad6ec47739695c348b8222470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:30.837807 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:30.838608 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:30.840456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 844/1699] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:30 2021] DELETE /identity/v3/projects/98e787aad6ec47739695c348b8222470 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:30.847672 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb455ec-1ac1-428d-a6f7-ae9068309741 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:30.848614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb455ec-1ac1-428d-a6f7-ae9068309741 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:30.849060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb455ec-1ac1-428d-a6f7-ae9068309741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:30.871016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-1bb455ec-1ac1-428d-a6f7-ae9068309741 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:30.873084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1bb455ec-1ac1-428d-a6f7-ae9068309741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:30.930241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:30.931835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:30.983803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 856/1700] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:30.992020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db6b03-82a9-41e3-a99a-0f97bd774731 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:30.994174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db6b03-82a9-41e3-a99a-0f97bd774731 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:30.994603 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db6b03-82a9-41e3-a99a-0f97bd774731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:31.034654 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b2db6b03-82a9-41e3-a99a-0f97bd774731 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:31.036456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b2db6b03-82a9-41e3-a99a-0f97bd774731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:31.051336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 857/1701] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:31.066071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db6b03-82a9-41e3-a99a-0f97bd774731 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:31.098175 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469300f-148e-42ab-a78d-178b187991f2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:31.107398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:31.107398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:31.107398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:31.107398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] PATH_INFO: `/v3/projects/f618c73686df4473a8f2c15b1ebbb24d` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:31.111415 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f618c73686df4473a8f2c15b1ebbb24d)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:31.121444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:31.124576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db6b03-82a9-41e3-a99a-0f97bd774731 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:31.145065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1384e-dd30-4f98-8fc8-7fa535122824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:31.145818 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1384e-dd30-4f98-8fc8-7fa535122824 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:31.146099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1384e-dd30-4f98-8fc8-7fa535122824 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:31.146379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1384e-dd30-4f98-8fc8-7fa535122824 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:31.147129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1384e-dd30-4f98-8fc8-7fa535122824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:31.147438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1384e-dd30-4f98-8fc8-7fa535122824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:31.149100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1384e-dd30-4f98-8fc8-7fa535122824 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:31.192559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 858/1702] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:31.193731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1384e-dd30-4f98-8fc8-7fa535122824 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:31.206112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1384e-dd30-4f98-8fc8-7fa535122824 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:31.211644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f4af7-4f34-4c94-a8da-76fb5c007227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:31.212314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f4af7-4f34-4c94-a8da-76fb5c007227 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:31.212685 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f4af7-4f34-4c94-a8da-76fb5c007227 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:31.212941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f4af7-4f34-4c94-a8da-76fb5c007227 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:31.213803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f4af7-4f34-4c94-a8da-76fb5c007227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:31.215768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f4af7-4f34-4c94-a8da-76fb5c007227 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:31.257958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f618c73686df4473a8f2c15b1ebbb24d', 'request_id': 'req-c2cfae1e-f004-406d-839e-01f6e017ac20'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.302289 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 859/1703] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:31 2021] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:31.306485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f4af7-4f34-4c94-a8da-76fb5c007227 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:31.307491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f618c73686df4473a8f2c15b1ebbb24d', 'request_id': 'req-c2cfae1e-f004-406d-839e-01f6e017ac20'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.316811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f618c73686df4473a8f2c15b1ebbb24d', 'request_id': 'req-c2cfae1e-f004-406d-839e-01f6e017ac20'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.328540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] The token cache is being invalidate because project f618c73686df4473a8f2c15b1ebbb24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:31.329156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.330171 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.331761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 845/1704] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:30 2021] DELETE /identity/v3/projects/f618c73686df4473a8f2c15b1ebbb24d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:31.335692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:31.337110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:31.394169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f4af7-4f34-4c94-a8da-76fb5c007227 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:31.399262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b229259-72df-4f4c-93d5-dac566c23b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:31.399939 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b229259-72df-4f4c-93d5-dac566c23b53 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:31.400224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b229259-72df-4f4c-93d5-dac566c23b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:31.400525 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b229259-72df-4f4c-93d5-dac566c23b53 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:31.401287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b229259-72df-4f4c-93d5-dac566c23b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:31.403217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b229259-72df-4f4c-93d5-dac566c23b53 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:31.439678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfae1e-f004-406d-839e-01f6e017ac20 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:31.444858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:31.445674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:31.445957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:31.446220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] PATH_INFO: `/v3/users/f434e90361dc4fd080b547e01a46b0c3` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:31.447499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f434e90361dc4fd080b547e01a46b0c3)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:31.449471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:31.528130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 860/1705] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:31 2021] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:31.529952 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b229259-72df-4f4c-93d5-dac566c23b53 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:31.532813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7b229259-72df-4f4c-93d5-dac566c23b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:31.547858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b229259-72df-4f4c-93d5-dac566c23b53 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:31.553574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:31.554361 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:31.554707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:31.554987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] PATH_INFO: `/v3/projects/4d3123c86a8145bf83c17bc2329250d5` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:31.556681 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3123c86a8145bf83c17bc2329250d5)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:31.558597 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:31.775895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f434e90361dc4fd080b547e01a46b0c3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.776470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f434e90361dc4fd080b547e01a46b0c3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.777130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f434e90361dc4fd080b547e01a46b0c3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.780206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3123c86a8145bf83c17bc2329250d5', 'request_id': 'req-f856b0f4-ae24-429a-af61-58e12e339922'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.788056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3123c86a8145bf83c17bc2329250d5', 'request_id': 'req-f856b0f4-ae24-429a-af61-58e12e339922'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.791719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f434e90361dc4fd080b547e01a46b0c3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.795831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3123c86a8145bf83c17bc2329250d5', 'request_id': 'req-f856b0f4-ae24-429a-af61-58e12e339922'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.871848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f434e90361dc4fd080b547e01a46b0c3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.885022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 846/1706] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:31 2021] DELETE /identity/v3/users/f434e90361dc4fd080b547e01a46b0c3 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:31.888097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:31.888097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:31.938049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] The token cache is being invalidate because project 4d3123c86a8145bf83c17bc2329250d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:31.941020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.941020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:31.941020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 861/1707] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:31 2021] DELETE /identity/v3/projects/4d3123c86a8145bf83c17bc2329250d5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:31.941748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:31.946506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:31.955916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cce875-1d78-4fed-91c6-2ac7cce45f14 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:31.962353 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4a20a-f797-4e79-b9a1-402fa30a2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:31.963298 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4a20a-f797-4e79-b9a1-402fa30a2cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:31.963861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4a20a-f797-4e79-b9a1-402fa30a2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:31.964031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4a20a-f797-4e79-b9a1-402fa30a2cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:31.964913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4a20a-f797-4e79-b9a1-402fa30a2cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:31.966678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4a20a-f797-4e79-b9a1-402fa30a2cb4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:31.979193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 847/1708] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:31 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:31.981316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc413310-989f-4d70-9f23-00818461cfe9 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:31.983867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc413310-989f-4d70-9f23-00818461cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:31.984588 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc413310-989f-4d70-9f23-00818461cfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.008873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-bc413310-989f-4d70-9f23-00818461cfe9 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:32.010214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-bc413310-989f-4d70-9f23-00818461cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:32.027950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 848/1709] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:32.027950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc413310-989f-4d70-9f23-00818461cfe9 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:32.027950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-bc413310-989f-4d70-9f23-00818461cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:32.040124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc413310-989f-4d70-9f23-00818461cfe9 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:32.047671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeca58b-2b08-49e5-a41e-f3423dd2a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:32.048344 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeca58b-2b08-49e5-a41e-f3423dd2a887 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:32.048837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeca58b-2b08-49e5-a41e-f3423dd2a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:32.049115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeca58b-2b08-49e5-a41e-f3423dd2a887 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.049847 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeca58b-2b08-49e5-a41e-f3423dd2a887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:32.050729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856b0f4-ae24-429a-af61-58e12e339922 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:32.051581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeca58b-2b08-49e5-a41e-f3423dd2a887 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:32.055978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:32.056903 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:32.057628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:32.058660 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] PATH_INFO: `/v3/projects/cf01048877b74687a9aef60d7dc38218` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.066190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf01048877b74687a9aef60d7dc38218)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:32.070913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 849/1710] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:32 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:32.070913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb39ef-935d-4a80-9364-2ac7571834b8 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:32.070913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb39ef-935d-4a80-9364-2ac7571834b8 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:32.070913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb39ef-935d-4a80-9364-2ac7571834b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.071196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:32.087596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-94eb39ef-935d-4a80-9364-2ac7571834b8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:32.088838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-94eb39ef-935d-4a80-9364-2ac7571834b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:32.106227 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 850/1711] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:32.106227 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb39ef-935d-4a80-9364-2ac7571834b8 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:32.116774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb39ef-935d-4a80-9364-2ac7571834b8 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:32.123290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8f9a-5c5d-4d7b-ba89-5b9333811fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:32.123817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8f9a-5c5d-4d7b-ba89-5b9333811fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:32.124108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8f9a-5c5d-4d7b-ba89-5b9333811fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:32.124422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8f9a-5c5d-4d7b-ba89-5b9333811fc6 admin admin] PATH_INFO: `/v3/projects/729eeb61015b408486d23db56734148e/users/9faa8141d8b545c4861abee6c2e7a6d2/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.139392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8f9a-5c5d-4d7b-ba89-5b9333811fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729eeb61015b408486d23db56734148e, user_id=9faa8141d8b545c4861abee6c2e7a6d2, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:32.142486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8f9a-5c5d-4d7b-ba89-5b9333811fc6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:32.251394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 851/1712] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:32 2021] PUT /identity/v3/projects/729eeb61015b408486d23db56734148e/users/9faa8141d8b545c4861abee6c2e7a6d2/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:32.253142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8f9a-5c5d-4d7b-ba89-5b9333811fc6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:32.279460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf01048877b74687a9aef60d7dc38218', 'request_id': 'req-dacf9b08-0560-47bb-930e-da871b294cff'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:32.322050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf01048877b74687a9aef60d7dc38218', 'request_id': 'req-dacf9b08-0560-47bb-930e-da871b294cff'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:32.342049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf01048877b74687a9aef60d7dc38218', 'request_id': 'req-dacf9b08-0560-47bb-930e-da871b294cff'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:32.367838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8f9a-5c5d-4d7b-ba89-5b9333811fc6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:32.431259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] The token cache is being invalidate because project cf01048877b74687a9aef60d7dc38218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:32.433072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:32.433072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dacf9b08-0560-47bb-930e-da871b294cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:32.443444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 862/1713] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:31 2021] DELETE /identity/v3/projects/cf01048877b74687a9aef60d7dc38218 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:32.445012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5adc6-4b4c-4b00-afcb-de03482d0482 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:32.446042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5adc6-4b4c-4b00-afcb-de03482d0482 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:32.446286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5adc6-4b4c-4b00-afcb-de03482d0482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.471968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07734d4e-c4ea-4400-9466-c808e0dbd26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:32.472691 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734d4e-c4ea-4400-9466-c808e0dbd26c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:32.472979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734d4e-c4ea-4400-9466-c808e0dbd26c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:32.473317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734d4e-c4ea-4400-9466-c808e0dbd26c admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.474225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734d4e-c4ea-4400-9466-c808e0dbd26c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:32.474552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734d4e-c4ea-4400-9466-c808e0dbd26c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:32.477500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734d4e-c4ea-4400-9466-c808e0dbd26c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:32.503988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-9ee5adc6-4b4c-4b00-afcb-de03482d0482 None None] MFA Rules not processed for user `9faa8141d8b545c4861abee6c2e7a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:32.506764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 852/1714] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:32.508146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad6e93-7976-408f-b3f7-0d919055c0ae None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:32.508468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad6e93-7976-408f-b3f7-0d919055c0ae None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:32.508757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad6e93-7976-408f-b3f7-0d919055c0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.512019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9ee5adc6-4b4c-4b00-afcb-de03482d0482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:32.549717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-8dad6e93-7976-408f-b3f7-0d919055c0ae None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:32.553498 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8dad6e93-7976-408f-b3f7-0d919055c0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:32.591492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 853/1715] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:32.597682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad6e93-7976-408f-b3f7-0d919055c0ae None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:32.604481 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8dad6e93-7976-408f-b3f7-0d919055c0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:32.652613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad6e93-7976-408f-b3f7-0d919055c0ae None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:32.660074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 863/1716] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:32 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:32.664442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838ade-a0d5-43bc-8f46-5a8777caf42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:32.664442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838ade-a0d5-43bc-8f46-5a8777caf42e admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:32.664442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838ade-a0d5-43bc-8f46-5a8777caf42e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:32.664811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e331b33-5b12-4a87-82b9-46e463ceafa4 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:32.664922 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838ade-a0d5-43bc-8f46-5a8777caf42e admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.665006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e331b33-5b12-4a87-82b9-46e463ceafa4 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:32.665006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e331b33-5b12-4a87-82b9-46e463ceafa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.665141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838ade-a0d5-43bc-8f46-5a8777caf42e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:32.666065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838ade-a0d5-43bc-8f46-5a8777caf42e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:32.693867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-9e331b33-5b12-4a87-82b9-46e463ceafa4 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:32.695302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9e331b33-5b12-4a87-82b9-46e463ceafa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:32.712907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 864/1717] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:32.714226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e331b33-5b12-4a87-82b9-46e463ceafa4 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:32.715500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9e331b33-5b12-4a87-82b9-46e463ceafa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:32.734371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e331b33-5b12-4a87-82b9-46e463ceafa4 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:32.741182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69646ab-9f69-4cbf-aacd-9b3888f7d901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:32.742128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69646ab-9f69-4cbf-aacd-9b3888f7d901 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:32.742476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69646ab-9f69-4cbf-aacd-9b3888f7d901 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:32.742818 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69646ab-9f69-4cbf-aacd-9b3888f7d901 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:32.743666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69646ab-9f69-4cbf-aacd-9b3888f7d901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:32.745857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69646ab-9f69-4cbf-aacd-9b3888f7d901 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:32.878668 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 865/1718] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:32 2021] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:32.880498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69646ab-9f69-4cbf-aacd-9b3888f7d901 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:32.882772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d69646ab-9f69-4cbf-aacd-9b3888f7d901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:32.906885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 854/1719] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:32 2021] POST /identity/v3/projects => generated 379 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:32.906885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838ade-a0d5-43bc-8f46-5a8777caf42e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.052160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69646ab-9f69-4cbf-aacd-9b3888f7d901 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.094330 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838ade-a0d5-43bc-8f46-5a8777caf42e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.099918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac70b6e-1ca2-4bab-8b63-a266df80c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.100645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac70b6e-1ca2-4bab-8b63-a266df80c4aa admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.100933 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac70b6e-1ca2-4bab-8b63-a266df80c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.108209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac70b6e-1ca2-4bab-8b63-a266df80c4aa admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.108209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac70b6e-1ca2-4bab-8b63-a266df80c4aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:33.108209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac70b6e-1ca2-4bab-8b63-a266df80c4aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.108209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac70b6e-1ca2-4bab-8b63-a266df80c4aa admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.117712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 855/1720] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:33.118702 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac70b6e-1ca2-4bab-8b63-a266df80c4aa admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.146325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac70b6e-1ca2-4bab-8b63-a266df80c4aa admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.157568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3e9a7-41fd-4769-9824-c83c9260255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.158744 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e9a7-41fd-4769-9824-c83c9260255c admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.159115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e9a7-41fd-4769-9824-c83c9260255c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.160275 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e9a7-41fd-4769-9824-c83c9260255c admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.162214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3e9a7-41fd-4769-9824-c83c9260255c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.164801 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3e9a7-41fd-4769-9824-c83c9260255c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.167236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.168442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.169584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.169997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] PATH_INFO: `/v3/projects/c79ef704804f424e9a2ec5b491670299` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.171991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79ef704804f424e9a2ec5b491670299)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.174836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.281760 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 856/1721] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:33 2021] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:33.282661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3e9a7-41fd-4769-9824-c83c9260255c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.296581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3e9a7-41fd-4769-9824-c83c9260255c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.303022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79ef704804f424e9a2ec5b491670299', 'request_id': 'req-173c6ec4-c95a-4f9c-995e-e8440985e194'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:33.310532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79ef704804f424e9a2ec5b491670299', 'request_id': 'req-173c6ec4-c95a-4f9c-995e-e8440985e194'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:33.326249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79ef704804f424e9a2ec5b491670299', 'request_id': 'req-173c6ec4-c95a-4f9c-995e-e8440985e194'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:33.360450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd0360-2647-40ab-8c6e-11a11cc3f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.361735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd0360-2647-40ab-8c6e-11a11cc3f9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.361735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd0360-2647-40ab-8c6e-11a11cc3f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.361735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd0360-2647-40ab-8c6e-11a11cc3f9d1 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.362477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd0360-2647-40ab-8c6e-11a11cc3f9d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.364607 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd0360-2647-40ab-8c6e-11a11cc3f9d1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.407026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] The token cache is being invalidate because project c79ef704804f424e9a2ec5b491670299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:33.410926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:33.410926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:33.410926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 866/1722] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:32 2021] DELETE /identity/v3/projects/c79ef704804f424e9a2ec5b491670299 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:33.410926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.412183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:33.437130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c6ec4-c95a-4f9c-995e-e8440985e194 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.442099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9fc92-4eea-47ca-af55-86141f9bb49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.442815 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9fc92-4eea-47ca-af55-86141f9bb49b admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.444897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9fc92-4eea-47ca-af55-86141f9bb49b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.444897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9fc92-4eea-47ca-af55-86141f9bb49b admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.444897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9fc92-4eea-47ca-af55-86141f9bb49b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.446230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9fc92-4eea-47ca-af55-86141f9bb49b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.469249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 857/1723] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:33 2021] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:33.473683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd0360-2647-40ab-8c6e-11a11cc3f9d1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.475909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e4cd0360-2647-40ab-8c6e-11a11cc3f9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:33.489686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd0360-2647-40ab-8c6e-11a11cc3f9d1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.495236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702429a-1b69-4f5d-b779-da8912602132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.495906 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702429a-1b69-4f5d-b779-da8912602132 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.496195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702429a-1b69-4f5d-b779-da8912602132 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.496511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702429a-1b69-4f5d-b779-da8912602132 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.497299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702429a-1b69-4f5d-b779-da8912602132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.499623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702429a-1b69-4f5d-b779-da8912602132 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.534755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 858/1724] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:33 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:33.541721 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd216-946d-4787-8a1d-d30c214cd88d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.542019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd216-946d-4787-8a1d-d30c214cd88d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.544028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd216-946d-4787-8a1d-d30c214cd88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.579038 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 867/1725] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:33 2021] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:33.579944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9fc92-4eea-47ca-af55-86141f9bb49b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.584004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-35c9fc92-4eea-47ca-af55-86141f9bb49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:33.584748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-362cd216-946d-4787-8a1d-d30c214cd88d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:33.586313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-362cd216-946d-4787-8a1d-d30c214cd88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:33.660148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9fc92-4eea-47ca-af55-86141f9bb49b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.672719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c600f-24cd-406c-aa43-72cc6fe88300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.673647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c600f-24cd-406c-aa43-72cc6fe88300 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.673931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c600f-24cd-406c-aa43-72cc6fe88300 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.674280 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c600f-24cd-406c-aa43-72cc6fe88300 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.675374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c600f-24cd-406c-aa43-72cc6fe88300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.685899 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c600f-24cd-406c-aa43-72cc6fe88300 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.686867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 859/1726] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:33.688438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cd216-946d-4787-8a1d-d30c214cd88d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.699177 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 868/1727] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:33 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:33.700042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c600f-24cd-406c-aa43-72cc6fe88300 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.704803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cd216-946d-4787-8a1d-d30c214cd88d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.711249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c600f-24cd-406c-aa43-72cc6fe88300 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.716945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b6b4a-dc5d-4515-a067-f13b9c8f6ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.717789 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b6b4a-dc5d-4515-a067-f13b9c8f6ddf admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.718089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b6b4a-dc5d-4515-a067-f13b9c8f6ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.718368 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b6b4a-dc5d-4515-a067-f13b9c8f6ddf admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.719495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b6b4a-dc5d-4515-a067-f13b9c8f6ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.721154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b6b4a-dc5d-4515-a067-f13b9c8f6ddf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.724606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acebd90-2e0d-4a6e-aa5f-828a92b678bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.725974 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acebd90-2e0d-4a6e-aa5f-828a92b678bb admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.726632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acebd90-2e0d-4a6e-aa5f-828a92b678bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.727377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acebd90-2e0d-4a6e-aa5f-828a92b678bb admin admin] PATH_INFO: `/v3/projects/2387c4e562ef4792ad9f550e227d7911/users/e08d58e10f654919acac590029274f28/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.749710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acebd90-2e0d-4a6e-aa5f-828a92b678bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2387c4e562ef4792ad9f550e227d7911, user_id=e08d58e10f654919acac590029274f28, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.752345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acebd90-2e0d-4a6e-aa5f-828a92b678bb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.809532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 869/1728] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:33 2021] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:33.809532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86170b5e-89d8-4d08-80f4-39bd96634971 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.809532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86170b5e-89d8-4d08-80f4-39bd96634971 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.809532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86170b5e-89d8-4d08-80f4-39bd96634971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.834499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-86170b5e-89d8-4d08-80f4-39bd96634971 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:33.836204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-86170b5e-89d8-4d08-80f4-39bd96634971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:33.848883 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 870/1729] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:33.850285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86170b5e-89d8-4d08-80f4-39bd96634971 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.862535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 860/1730] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:33 2021] PUT /identity/v3/projects/2387c4e562ef4792ad9f550e227d7911/users/e08d58e10f654919acac590029274f28/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:33.863535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acebd90-2e0d-4a6e-aa5f-828a92b678bb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.871745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86170b5e-89d8-4d08-80f4-39bd96634971 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.935308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb80058-2cb5-4bef-9d51-67f99df34c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.936030 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80058-2cb5-4bef-9d51-67f99df34c9e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.936319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80058-2cb5-4bef-9d51-67f99df34c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.936626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80058-2cb5-4bef-9d51-67f99df34c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.937369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb80058-2cb5-4bef-9d51-67f99df34c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.938987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb80058-2cb5-4bef-9d51-67f99df34c9e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.949740 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 871/1731] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:33 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:33.951365 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb80058-2cb5-4bef-9d51-67f99df34c9e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:33.965875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb80058-2cb5-4bef-9d51-67f99df34c9e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:33.972040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800a621-16bd-411c-bd20-39230a16d7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:33.972890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a621-16bd-411c-bd20-39230a16d7fe admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:33.973428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a621-16bd-411c-bd20-39230a16d7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:33.973817 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a621-16bd-411c-bd20-39230a16d7fe admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:33.974623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a621-16bd-411c-bd20-39230a16d7fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:33.975020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a621-16bd-411c-bd20-39230a16d7fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:33.977222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a621-16bd-411c-bd20-39230a16d7fe admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:33.991213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 872/1732] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:33.995549 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800a621-16bd-411c-bd20-39230a16d7fe admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.007599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acebd90-2e0d-4a6e-aa5f-828a92b678bb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.020391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334599b-2df7-4da3-a29a-d252bb820d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.022754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334599b-2df7-4da3-a29a-d252bb820d55 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.023501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334599b-2df7-4da3-a29a-d252bb820d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.024131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334599b-2df7-4da3-a29a-d252bb820d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.025311 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334599b-2df7-4da3-a29a-d252bb820d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.027829 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800a621-16bd-411c-bd20-39230a16d7fe admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.028128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334599b-2df7-4da3-a29a-d252bb820d55 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:34.037654 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73f3cc-b79b-45d4-b50c-99bce66fcde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.038571 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73f3cc-b79b-45d4-b50c-99bce66fcde5 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.038680 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73f3cc-b79b-45d4-b50c-99bce66fcde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.039040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73f3cc-b79b-45d4-b50c-99bce66fcde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.039785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73f3cc-b79b-45d4-b50c-99bce66fcde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.041615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73f3cc-b79b-45d4-b50c-99bce66fcde5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:34.050820 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 861/1733] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:33 2021] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:34.052110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334599b-2df7-4da3-a29a-d252bb820d55 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.054252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 873/1734] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:33 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:34.058229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73f3cc-b79b-45d4-b50c-99bce66fcde5 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.065849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334599b-2df7-4da3-a29a-d252bb820d55 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.066194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73f3cc-b79b-45d4-b50c-99bce66fcde5 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.071408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d78058-7467-46bd-8e48-660d65022b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.072048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78058-7467-46bd-8e48-660d65022b6a admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.072345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78058-7467-46bd-8e48-660d65022b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.072660 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78058-7467-46bd-8e48-660d65022b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.073537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d78058-7467-46bd-8e48-660d65022b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.074007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886727b-ac17-493c-b5d3-7a020b82371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.076414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d78058-7467-46bd-8e48-660d65022b6a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:34.076745 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886727b-ac17-493c-b5d3-7a020b82371a admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.077229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886727b-ac17-493c-b5d3-7a020b82371a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.077735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886727b-ac17-493c-b5d3-7a020b82371a admin admin] PATH_INFO: `/v3/projects/12fb214082ac412081e6b3fa6201f949/users/18a580b0890842c888877a18f07e8b05/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.101099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886727b-ac17-493c-b5d3-7a020b82371a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fb214082ac412081e6b3fa6201f949, user_id=18a580b0890842c888877a18f07e8b05, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.106112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886727b-ac17-493c-b5d3-7a020b82371a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:34.178308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 874/1735] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:34 2021] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:34.178308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d78058-7467-46bd-8e48-660d65022b6a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.217210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 862/1736] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:34 2021] PUT /identity/v3/projects/12fb214082ac412081e6b3fa6201f949/users/18a580b0890842c888877a18f07e8b05/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:34.227373 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886727b-ac17-493c-b5d3-7a020b82371a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.291496 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d78058-7467-46bd-8e48-660d65022b6a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.298615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886727b-ac17-493c-b5d3-7a020b82371a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.299316 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966632d3-6264-4b81-9e0c-4cb94fcb6b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.300576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966632d3-6264-4b81-9e0c-4cb94fcb6b2b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.300983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966632d3-6264-4b81-9e0c-4cb94fcb6b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.301341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966632d3-6264-4b81-9e0c-4cb94fcb6b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.302370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966632d3-6264-4b81-9e0c-4cb94fcb6b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.304508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99687f36-e004-4e88-bc93-0bcddf95e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.304642 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966632d3-6264-4b81-9e0c-4cb94fcb6b2b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:34.305413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687f36-e004-4e88-bc93-0bcddf95e67c admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.305700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687f36-e004-4e88-bc93-0bcddf95e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.305979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687f36-e004-4e88-bc93-0bcddf95e67c admin admin] PATH_INFO: `/v3/projects/2387c4e562ef4792ad9f550e227d7911/users/e08d58e10f654919acac590029274f28/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.308006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99687f36-e004-4e88-bc93-0bcddf95e67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2387c4e562ef4792ad9f550e227d7911, user_id=e08d58e10f654919acac590029274f28, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.311798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99687f36-e004-4e88-bc93-0bcddf95e67c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:34.320017 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 875/1737] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:34 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:34.321928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966632d3-6264-4b81-9e0c-4cb94fcb6b2b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.327893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 863/1738] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:34 2021] PUT /identity/v3/projects/2387c4e562ef4792ad9f550e227d7911/users/e08d58e10f654919acac590029274f28/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:34.329562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b8fd3-b0d0-4d90-bb52-f1599d9e4fda None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.329995 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b8fd3-b0d0-4d90-bb52-f1599d9e4fda None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.330285 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b8fd3-b0d0-4d90-bb52-f1599d9e4fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.335857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966632d3-6264-4b81-9e0c-4cb94fcb6b2b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.366029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-445b8fd3-b0d0-4d90-bb52-f1599d9e4fda None None] MFA Rules not processed for user `18a580b0890842c888877a18f07e8b05`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:34.367267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-445b8fd3-b0d0-4d90-bb52-f1599d9e4fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:34.431842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb1365-3a7c-401f-a3ae-d6fa2d16eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.432892 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb1365-3a7c-401f-a3ae-d6fa2d16eb84 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.433187 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb1365-3a7c-401f-a3ae-d6fa2d16eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.433467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb1365-3a7c-401f-a3ae-d6fa2d16eb84 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.434163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb1365-3a7c-401f-a3ae-d6fa2d16eb84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.438095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb1365-3a7c-401f-a3ae-d6fa2d16eb84 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:34.444062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 864/1739] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:34 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:34.448726 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b8fd3-b0d0-4d90-bb52-f1599d9e4fda None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.464127 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b8fd3-b0d0-4d90-bb52-f1599d9e4fda None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.472068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d84a3-d2e1-44c2-a217-26a840811f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.473190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d84a3-d2e1-44c2-a217-26a840811f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.474187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d84a3-d2e1-44c2-a217-26a840811f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.474479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d84a3-d2e1-44c2-a217-26a840811f0b admin admin] PATH_INFO: `/v3/projects/aea4ac4a8e2b4c499d81044f3ddedee4/users/c386ad95b8834c65bb6280b826ea39fc/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.493924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d84a3-d2e1-44c2-a217-26a840811f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea4ac4a8e2b4c499d81044f3ddedee4, user_id=c386ad95b8834c65bb6280b826ea39fc, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.497021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d84a3-d2e1-44c2-a217-26a840811f0b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:34.558037 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 876/1740] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:34 2021] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:34.560039 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c44a-0463-4b4c-8a8a-e5bf53159014 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.560340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c44a-0463-4b4c-8a8a-e5bf53159014 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.560702 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c44a-0463-4b4c-8a8a-e5bf53159014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.606107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a907c44a-0463-4b4c-8a8a-e5bf53159014 None None] MFA Rules not processed for user `e08d58e10f654919acac590029274f28`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:34.608249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a907c44a-0463-4b4c-8a8a-e5bf53159014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:34.656665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 865/1741] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:34 2021] PUT /identity/v3/projects/aea4ac4a8e2b4c499d81044f3ddedee4/users/c386ad95b8834c65bb6280b826ea39fc/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:34.658042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d84a3-d2e1-44c2-a217-26a840811f0b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.720825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 877/1742] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:34 2021] POST /identity/v3/auth/tokens => generated 3448 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:34.722537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907c44a-0463-4b4c-8a8a-e5bf53159014 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.737036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907c44a-0463-4b4c-8a8a-e5bf53159014 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.752621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d84a3-d2e1-44c2-a217-26a840811f0b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.758142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e16f6c-258c-47d0-b7d0-ace0d7eaa7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.758850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16f6c-258c-47d0-b7d0-ace0d7eaa7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.759110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16f6c-258c-47d0-b7d0-ace0d7eaa7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.759391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16f6c-258c-47d0-b7d0-ace0d7eaa7f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.760573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e16f6c-258c-47d0-b7d0-ace0d7eaa7f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.763535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e16f6c-258c-47d0-b7d0-ace0d7eaa7f2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:34.810143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85bc2d-4ba5-400b-b39e-0e50469eb39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.810843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85bc2d-4ba5-400b-b39e-0e50469eb39e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.811127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85bc2d-4ba5-400b-b39e-0e50469eb39e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.811734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85bc2d-4ba5-400b-b39e-0e50469eb39e admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.812150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85bc2d-4ba5-400b-b39e-0e50469eb39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.813782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85bc2d-4ba5-400b-b39e-0e50469eb39e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:34.823825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 878/1743] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:34 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:34.824995 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79898645-8399-4e5f-b357-18c64c0afc73 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.825803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79898645-8399-4e5f-b357-18c64c0afc73 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.826093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79898645-8399-4e5f-b357-18c64c0afc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.853040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-79898645-8399-4e5f-b357-18c64c0afc73 None None] MFA Rules not processed for user `c386ad95b8834c65bb6280b826ea39fc`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:34.854443 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-79898645-8399-4e5f-b357-18c64c0afc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:34.862455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 866/1744] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:34 2021] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:34.863309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e16f6c-258c-47d0-b7d0-ace0d7eaa7f2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.867787 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-30e16f6c-258c-47d0-b7d0-ace0d7eaa7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:34.931461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 879/1745] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:34 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:34.932331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79898645-8399-4e5f-b357-18c64c0afc73 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.946260 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79898645-8399-4e5f-b357-18c64c0afc73 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.963883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e16f6c-258c-47d0-b7d0-ace0d7eaa7f2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.968412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3649c31-0681-465b-8d54-d85661abcf47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.969253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3649c31-0681-465b-8d54-d85661abcf47 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.969547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3649c31-0681-465b-8d54-d85661abcf47 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.974766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3649c31-0681-465b-8d54-d85661abcf47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.053964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083d65a-fb34-4016-9708-c3c0f8fbc4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.053964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083d65a-fb34-4016-9708-c3c0f8fbc4ec admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.053964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083d65a-fb34-4016-9708-c3c0f8fbc4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.053964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083d65a-fb34-4016-9708-c3c0f8fbc4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.054392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083d65a-fb34-4016-9708-c3c0f8fbc4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.054392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083d65a-fb34-4016-9708-c3c0f8fbc4ec admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.080374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 880/1746] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:34 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:35.080671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3649c31-0681-465b-8d54-d85661abcf47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.081683 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083d65a-fb34-4016-9708-c3c0f8fbc4ec admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.082175 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3649c31-0681-465b-8d54-d85661abcf47 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.104284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083d65a-fb34-4016-9708-c3c0f8fbc4ec admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.110117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 867/1747] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:34 2021] GET /identity/v3/auth/tokens => generated 3448 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:35.111489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3649c31-0681-465b-8d54-d85661abcf47 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.124603 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3649c31-0681-465b-8d54-d85661abcf47 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.131989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c78e9b-751f-4843-8150-16b55e841561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.132985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb09c5a-86f2-4388-8f62-26220afafd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.133300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c78e9b-751f-4843-8150-16b55e841561 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.133478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c78e9b-751f-4843-8150-16b55e841561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.133700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c78e9b-751f-4843-8150-16b55e841561 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.134406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c78e9b-751f-4843-8150-16b55e841561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.135257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb09c5a-86f2-4388-8f62-26220afafd02 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.136255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb09c5a-86f2-4388-8f62-26220afafd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.136403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c78e9b-751f-4843-8150-16b55e841561 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.138243 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb09c5a-86f2-4388-8f62-26220afafd02 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.139166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb09c5a-86f2-4388-8f62-26220afafd02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.142757 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb09c5a-86f2-4388-8f62-26220afafd02 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.238889 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 881/1748] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:35 2021] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:35.244385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb09c5a-86f2-4388-8f62-26220afafd02 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.246760 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 868/1749] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:35 2021] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:35.248236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c78e9b-751f-4843-8150-16b55e841561 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.268101 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb09c5a-86f2-4388-8f62-26220afafd02 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.363962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eab8e-2995-43b7-8e4b-0c4692a7d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.365408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eab8e-2995-43b7-8e4b-0c4692a7d499 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.365907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eab8e-2995-43b7-8e4b-0c4692a7d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.367028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eab8e-2995-43b7-8e4b-0c4692a7d499 admin admin] PATH_INFO: `/v3/projects/3c2b2712835840c79986dfe7e112f028/users/25d4c30c0cd04b9f824fc85be280f200/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.371905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c78e9b-751f-4843-8150-16b55e841561 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.384606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8913163-6888-469d-9717-30a6ec606115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.385700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8913163-6888-469d-9717-30a6ec606115 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.386254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8913163-6888-469d-9717-30a6ec606115 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.386736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8913163-6888-469d-9717-30a6ec606115 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.389157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8913163-6888-469d-9717-30a6ec606115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.391324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8913163-6888-469d-9717-30a6ec606115 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.397758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0eab8e-2995-43b7-8e4b-0c4692a7d499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2b2712835840c79986dfe7e112f028, user_id=25d4c30c0cd04b9f824fc85be280f200, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.401220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0eab8e-2995-43b7-8e4b-0c4692a7d499 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.407677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 869/1750] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:35 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:35.410010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8913163-6888-469d-9717-30a6ec606115 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.431395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8913163-6888-469d-9717-30a6ec606115 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.439831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db34a2f-78f5-4017-88ff-f4f6059ed1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.440903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db34a2f-78f5-4017-88ff-f4f6059ed1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.441331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db34a2f-78f5-4017-88ff-f4f6059ed1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.441754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db34a2f-78f5-4017-88ff-f4f6059ed1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.442731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db34a2f-78f5-4017-88ff-f4f6059ed1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.445327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db34a2f-78f5-4017-88ff-f4f6059ed1b3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.509836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 882/1751] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:35 2021] PUT /identity/v3/projects/3c2b2712835840c79986dfe7e112f028/users/25d4c30c0cd04b9f824fc85be280f200/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:35.510788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eab8e-2995-43b7-8e4b-0c4692a7d499 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.581138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eab8e-2995-43b7-8e4b-0c4692a7d499 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.585893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c43538-c95c-428d-9000-6dde6c90c6ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.586616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43538-c95c-428d-9000-6dde6c90c6ac service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.586900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43538-c95c-428d-9000-6dde6c90c6ac service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.587181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43538-c95c-428d-9000-6dde6c90c6ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.589394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-92c43538-c95c-428d-9000-6dde6c90c6ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:35.614418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 870/1752] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:35 2021] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:35.615407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db34a2f-78f5-4017-88ff-f4f6059ed1b3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.628392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db34a2f-78f5-4017-88ff-f4f6059ed1b3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.689739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c43538-c95c-428d-9000-6dde6c90c6ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.693231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c43538-c95c-428d-9000-6dde6c90c6ac service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.703217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 883/1753] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:35 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:35.704738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d62d7-3a58-4ad4-8901-ddd2ae7c57df None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.705234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d62d7-3a58-4ad4-8901-ddd2ae7c57df None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.706062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d62d7-3a58-4ad4-8901-ddd2ae7c57df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.706980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6595f2-4ae8-4268-9aa9-cc29e317adb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.707977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6595f2-4ae8-4268-9aa9-cc29e317adb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.708343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6595f2-4ae8-4268-9aa9-cc29e317adb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.708742 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6595f2-4ae8-4268-9aa9-cc29e317adb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.709562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6595f2-4ae8-4268-9aa9-cc29e317adb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.712119 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6595f2-4ae8-4268-9aa9-cc29e317adb4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.729486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 871/1754] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:35 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:35.730761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6595f2-4ae8-4268-9aa9-cc29e317adb4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.746027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6595f2-4ae8-4268-9aa9-cc29e317adb4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.752874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494afcbd-8d2e-49de-be32-5b1f24cd93a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.754481 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494afcbd-8d2e-49de-be32-5b1f24cd93a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.754973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494afcbd-8d2e-49de-be32-5b1f24cd93a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.755474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494afcbd-8d2e-49de-be32-5b1f24cd93a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.756555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494afcbd-8d2e-49de-be32-5b1f24cd93a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.758808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494afcbd-8d2e-49de-be32-5b1f24cd93a0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.763538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-6e9d62d7-3a58-4ad4-8901-ddd2ae7c57df None None] MFA Rules not processed for user `25d4c30c0cd04b9f824fc85be280f200`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:35.768520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6e9d62d7-3a58-4ad4-8901-ddd2ae7c57df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:35.773753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 872/1755] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:35 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:35.775007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494afcbd-8d2e-49de-be32-5b1f24cd93a0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.789354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494afcbd-8d2e-49de-be32-5b1f24cd93a0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.799475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d48319-c657-430d-8e37-ede9406d0325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.800532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48319-c657-430d-8e37-ede9406d0325 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.800894 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48319-c657-430d-8e37-ede9406d0325 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.801251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48319-c657-430d-8e37-ede9406d0325 admin admin] PATH_INFO: `/v3/projects/7713b928555a4e4986b4dd278c5db6b7/users/d113f0887498440cbf40c7b4d52709ff/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.821708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d48319-c657-430d-8e37-ede9406d0325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7713b928555a4e4986b4dd278c5db6b7, user_id=d113f0887498440cbf40c7b4d52709ff, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.825889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d48319-c657-430d-8e37-ede9406d0325 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.858202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 884/1756] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:35 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:35.859570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d62d7-3a58-4ad4-8901-ddd2ae7c57df None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.875602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d62d7-3a58-4ad4-8901-ddd2ae7c57df None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.881872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537f2e7-2ae8-4b9d-8c54-bfec71123979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.883373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f2e7-2ae8-4b9d-8c54-bfec71123979 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.883667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f2e7-2ae8-4b9d-8c54-bfec71123979 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.884128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f2e7-2ae8-4b9d-8c54-bfec71123979 admin admin] PATH_INFO: `/v3/projects/6c4bdb5af8c04deb9ac87fe648714812/users/e3a4fd505af746fca2bc579dea60d268/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.906088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537f2e7-2ae8-4b9d-8c54-bfec71123979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4bdb5af8c04deb9ac87fe648714812, user_id=e3a4fd505af746fca2bc579dea60d268, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.909259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537f2e7-2ae8-4b9d-8c54-bfec71123979 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.989236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 873/1757] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:35 2021] PUT /identity/v3/projects/7713b928555a4e4986b4dd278c5db6b7/users/d113f0887498440cbf40c7b4d52709ff/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:35.990674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d48319-c657-430d-8e37-ede9406d0325 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.056193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 885/1758] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:35 2021] PUT /identity/v3/projects/6c4bdb5af8c04deb9ac87fe648714812/users/e3a4fd505af746fca2bc579dea60d268/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:36.057008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38645a-45fb-4031-968b-e8d20cabc868 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.057299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38645a-45fb-4031-968b-e8d20cabc868 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.057579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38645a-45fb-4031-968b-e8d20cabc868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.068882 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d48319-c657-430d-8e37-ede9406d0325 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.098921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-1b38645a-45fb-4031-968b-e8d20cabc868 None None] MFA Rules not processed for user `d113f0887498440cbf40c7b4d52709ff`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:36.100367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1b38645a-45fb-4031-968b-e8d20cabc868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:36.186917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f309d-e511-4b61-846f-a9a0be7bf304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.187623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f309d-e511-4b61-846f-a9a0be7bf304 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.187910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f309d-e511-4b61-846f-a9a0be7bf304 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.188563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f309d-e511-4b61-846f-a9a0be7bf304 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.188914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f309d-e511-4b61-846f-a9a0be7bf304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.190853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f309d-e511-4b61-846f-a9a0be7bf304 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:36.236458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 886/1759] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:36 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:36.237887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38645a-45fb-4031-968b-e8d20cabc868 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.254595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38645a-45fb-4031-968b-e8d20cabc868 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.267145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edb368-6c3a-4fdc-b767-0adf59f38b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.267841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb368-6c3a-4fdc-b767-0adf59f38b57 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.268264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb368-6c3a-4fdc-b767-0adf59f38b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.268575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb368-6c3a-4fdc-b767-0adf59f38b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.270569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edb368-6c3a-4fdc-b767-0adf59f38b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.276251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edb368-6c3a-4fdc-b767-0adf59f38b57 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:36.291754 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 887/1760] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:36 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:36.292749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edb368-6c3a-4fdc-b767-0adf59f38b57 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.307804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edb368-6c3a-4fdc-b767-0adf59f38b57 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.311507 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cee8b-e29f-429f-a8fe-84471322a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.312377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cee8b-e29f-429f-a8fe-84471322a65d admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.312730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cee8b-e29f-429f-a8fe-84471322a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.313070 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cee8b-e29f-429f-a8fe-84471322a65d admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.313982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cee8b-e29f-429f-a8fe-84471322a65d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.316086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cee8b-e29f-429f-a8fe-84471322a65d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:36.335143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 874/1761] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:35 2021] POST /identity/v3/projects => generated 371 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:36.336570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f309d-e511-4b61-846f-a9a0be7bf304 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.412873 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 888/1762] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:36 2021] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:36.413519 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cee8b-e29f-429f-a8fe-84471322a65d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.426828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f309d-e511-4b61-846f-a9a0be7bf304 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.515229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd451f7-dba5-44a7-b189-5a8bf12c7ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.516732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd451f7-dba5-44a7-b189-5a8bf12c7ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.517117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd451f7-dba5-44a7-b189-5a8bf12c7ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.517460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd451f7-dba5-44a7-b189-5a8bf12c7ce6 admin admin] PATH_INFO: `/v3/projects/6c4bdb5af8c04deb9ac87fe648714812/users/e3a4fd505af746fca2bc579dea60d268/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.520189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd451f7-dba5-44a7-b189-5a8bf12c7ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4bdb5af8c04deb9ac87fe648714812, user_id=e3a4fd505af746fca2bc579dea60d268, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.524921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd451f7-dba5-44a7-b189-5a8bf12c7ce6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:36.548543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 875/1763] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:36 2021] PUT /identity/v3/projects/6c4bdb5af8c04deb9ac87fe648714812/users/e3a4fd505af746fca2bc579dea60d268/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:36.548543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd451f7-dba5-44a7-b189-5a8bf12c7ce6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.554589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cee8b-e29f-429f-a8fe-84471322a65d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.619242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd451f7-dba5-44a7-b189-5a8bf12c7ce6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.625476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d087e-a95e-4683-aeba-c65d0ba0e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.626215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d087e-a95e-4683-aeba-c65d0ba0e166 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.626564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d087e-a95e-4683-aeba-c65d0ba0e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.626905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d087e-a95e-4683-aeba-c65d0ba0e166 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.627668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d087e-a95e-4683-aeba-c65d0ba0e166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.629846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d087e-a95e-4683-aeba-c65d0ba0e166 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:36.640235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8becf9-f569-4a17-bf5b-5cf108ad87dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.641788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8becf9-f569-4a17-bf5b-5cf108ad87dd admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.642086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8becf9-f569-4a17-bf5b-5cf108ad87dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.642370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8becf9-f569-4a17-bf5b-5cf108ad87dd admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.643075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8becf9-f569-4a17-bf5b-5cf108ad87dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.646409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8becf9-f569-4a17-bf5b-5cf108ad87dd admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:36.756801 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 876/1764] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:36 2021] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:36.758299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe17ad-56d5-4302-9e5a-14fb5bab0011 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.758670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe17ad-56d5-4302-9e5a-14fb5bab0011 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.758936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe17ad-56d5-4302-9e5a-14fb5bab0011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.790234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 889/1765] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:36 2021] POST /identity/v3/users => generated 292 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:36.792473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8becf9-f569-4a17-bf5b-5cf108ad87dd admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.817424 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8becf9-f569-4a17-bf5b-5cf108ad87dd admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.823084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-63fe17ad-56d5-4302-9e5a-14fb5bab0011 None None] MFA Rules not processed for user `e3a4fd505af746fca2bc579dea60d268`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:36.824328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-63fe17ad-56d5-4302-9e5a-14fb5bab0011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:36.829485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf6401-aa7f-4f6a-829d-c2d04d4c790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.830673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf6401-aa7f-4f6a-829d-c2d04d4c790b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.831577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf6401-aa7f-4f6a-829d-c2d04d4c790b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.833377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf6401-aa7f-4f6a-829d-c2d04d4c790b admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.835042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf6401-aa7f-4f6a-829d-c2d04d4c790b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.837721 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf6401-aa7f-4f6a-829d-c2d04d4c790b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:36.858934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 890/1766] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:36 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:36.858934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf6401-aa7f-4f6a-829d-c2d04d4c790b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.877432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf6401-aa7f-4f6a-829d-c2d04d4c790b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.886467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e782907-c8b1-4bb7-82bd-8bda0bb0aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.888673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e782907-c8b1-4bb7-82bd-8bda0bb0aab8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.889191 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e782907-c8b1-4bb7-82bd-8bda0bb0aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.889704 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e782907-c8b1-4bb7-82bd-8bda0bb0aab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.893423 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e782907-c8b1-4bb7-82bd-8bda0bb0aab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.899648 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e782907-c8b1-4bb7-82bd-8bda0bb0aab8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:36.939141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 891/1767] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:36 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:36.940887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e782907-c8b1-4bb7-82bd-8bda0bb0aab8 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.955859 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e782907-c8b1-4bb7-82bd-8bda0bb0aab8 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.962359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e6b60-1144-4f9e-9d2e-3deee53ae0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.963819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6b60-1144-4f9e-9d2e-3deee53ae0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.964444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6b60-1144-4f9e-9d2e-3deee53ae0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.964763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6b60-1144-4f9e-9d2e-3deee53ae0b5 admin admin] PATH_INFO: `/v3/projects/065cdc69cce343e7bcbc76dc179b16ec/users/b966dca533514c59b5b93c3a4027bcf8/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.986680 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e6b60-1144-4f9e-9d2e-3deee53ae0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065cdc69cce343e7bcbc76dc179b16ec, user_id=b966dca533514c59b5b93c3a4027bcf8, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.989840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e6b60-1144-4f9e-9d2e-3deee53ae0b5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.021197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 877/1768] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:36 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:37.021197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe17ad-56d5-4302-9e5a-14fb5bab0011 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.037969 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe17ad-56d5-4302-9e5a-14fb5bab0011 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.053168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055d680-8c7a-4313-92dc-3470c98c4d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.055135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055d680-8c7a-4313-92dc-3470c98c4d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.055911 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055d680-8c7a-4313-92dc-3470c98c4d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.056670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055d680-8c7a-4313-92dc-3470c98c4d47 admin admin] PATH_INFO: `/v3/projects/8043b09571e341e8b47ecbb200ef3d77/users/064372e69b754ad69f9c2d28193c6e89/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.090397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 892/1769] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:36 2021] PUT /identity/v3/projects/065cdc69cce343e7bcbc76dc179b16ec/users/b966dca533514c59b5b93c3a4027bcf8/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:37.093191 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e6b60-1144-4f9e-9d2e-3deee53ae0b5 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.136820 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055d680-8c7a-4313-92dc-3470c98c4d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8043b09571e341e8b47ecbb200ef3d77, user_id=064372e69b754ad69f9c2d28193c6e89, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.148570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055d680-8c7a-4313-92dc-3470c98c4d47 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.303635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 878/1770] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:37 2021] PUT /identity/v3/projects/8043b09571e341e8b47ecbb200ef3d77/users/064372e69b754ad69f9c2d28193c6e89/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:37.319685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055d680-8c7a-4313-92dc-3470c98c4d47 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.319837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e6b60-1144-4f9e-9d2e-3deee53ae0b5 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.428277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055d680-8c7a-4313-92dc-3470c98c4d47 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.438019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278848f-7997-4b93-ac05-26b76bfac6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.438907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278848f-7997-4b93-ac05-26b76bfac6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.439011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278848f-7997-4b93-ac05-26b76bfac6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.439255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278848f-7997-4b93-ac05-26b76bfac6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.440063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278848f-7997-4b93-ac05-26b76bfac6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.442328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278848f-7997-4b93-ac05-26b76bfac6a3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.451959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.452908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.453192 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.453491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] PATH_INFO: `/v3/users/c386ad95b8834c65bb6280b826ea39fc` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.457351 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 879/1771] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:37 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:37.457528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c386ad95b8834c65bb6280b826ea39fc)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.457614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278848f-7997-4b93-ac05-26b76bfac6a3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.457693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.469564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278848f-7997-4b93-ac05-26b76bfac6a3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.475903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d16d9-47ea-4210-8f06-61fffcb52829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.477610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d16d9-47ea-4210-8f06-61fffcb52829 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.477911 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d16d9-47ea-4210-8f06-61fffcb52829 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.478171 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d16d9-47ea-4210-8f06-61fffcb52829 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.478960 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d16d9-47ea-4210-8f06-61fffcb52829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.480924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d16d9-47ea-4210-8f06-61fffcb52829 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.497410 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 880/1772] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:37 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:37.498473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d16d9-47ea-4210-8f06-61fffcb52829 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.509482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d16d9-47ea-4210-8f06-61fffcb52829 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.517858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fc545-253a-45f9-9183-ccd7ff669e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.520838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc545-253a-45f9-9183-ccd7ff669e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.521653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc545-253a-45f9-9183-ccd7ff669e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.522427 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc545-253a-45f9-9183-ccd7ff669e31 admin admin] PATH_INFO: `/v3/projects/065cdc69cce343e7bcbc76dc179b16ec/users/b966dca533514c59b5b93c3a4027bcf8/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.525013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fc545-253a-45f9-9183-ccd7ff669e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065cdc69cce343e7bcbc76dc179b16ec, user_id=b966dca533514c59b5b93c3a4027bcf8, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.528272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fc545-253a-45f9-9183-ccd7ff669e31 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.554938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 881/1773] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:37 2021] PUT /identity/v3/projects/065cdc69cce343e7bcbc76dc179b16ec/users/b966dca533514c59b5b93c3a4027bcf8/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:37.556511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409ac82-9374-45fa-843f-4440ee6d8b2a None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.556806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409ac82-9374-45fa-843f-4440ee6d8b2a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.557087 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409ac82-9374-45fa-843f-4440ee6d8b2a None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.559327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 882/1774] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 04:44:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:44:37.560717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409ac82-9374-45fa-843f-4440ee6d8b2a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.735990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409ac82-9374-45fa-843f-4440ee6d8b2a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.741586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23085797-a4d5-4d9a-afad-976108b0dd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.742805 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23085797-a4d5-4d9a-afad-976108b0dd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.743236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23085797-a4d5-4d9a-afad-976108b0dd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.743652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23085797-a4d5-4d9a-afad-976108b0dd8c admin admin] PATH_INFO: `/v3/projects/8043b09571e341e8b47ecbb200ef3d77/users/064372e69b754ad69f9c2d28193c6e89/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.746364 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23085797-a4d5-4d9a-afad-976108b0dd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8043b09571e341e8b47ecbb200ef3d77, user_id=064372e69b754ad69f9c2d28193c6e89, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.750082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23085797-a4d5-4d9a-afad-976108b0dd8c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.764760 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 883/1775] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:37 2021] PUT /identity/v3/projects/8043b09571e341e8b47ecbb200ef3d77/users/064372e69b754ad69f9c2d28193c6e89/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:37.766672 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c5597-dc5f-4f90-aaa2-89a80a86e216 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.766971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c5597-dc5f-4f90-aaa2-89a80a86e216 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.767255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c5597-dc5f-4f90-aaa2-89a80a86e216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.808415 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2b7c5597-dc5f-4f90-aaa2-89a80a86e216 None None] MFA Rules not processed for user `b966dca533514c59b5b93c3a4027bcf8`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:37.810496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2b7c5597-dc5f-4f90-aaa2-89a80a86e216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:38.166961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 884/1776] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:37 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:38.166961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548947cf-ddb5-40ae-8c8b-ce2c39ed5584 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:38.166961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548947cf-ddb5-40ae-8c8b-ce2c39ed5584 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:38.166961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548947cf-ddb5-40ae-8c8b-ce2c39ed5584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:38.166961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-548947cf-ddb5-40ae-8c8b-ce2c39ed5584 None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:38.166961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-548947cf-ddb5-40ae-8c8b-ce2c39ed5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:38.170155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 885/1777] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 04:44:37 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:38.170155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6b0b4-5f09-49a0-a3a4-a3da0666eee9 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:38.170155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6b0b4-5f09-49a0-a3a4-a3da0666eee9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:38.170155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6b0b4-5f09-49a0-a3a4-a3da0666eee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:38.170155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-88f6b0b4-5f09-49a0-a3a4-a3da0666eee9 None None] MFA Rules not processed for user `064372e69b754ad69f9c2d28193c6e89`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:38.170155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-88f6b0b4-5f09-49a0-a3a4-a3da0666eee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:38.240825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 886/1778] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:38 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:38.245110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6b0b4-5f09-49a0-a3a4-a3da0666eee9 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:38.326493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6b0b4-5f09-49a0-a3a4-a3da0666eee9 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:38.329958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2704aa-02b9-4c88-a8fa-5191caf4adf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:38.331056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2704aa-02b9-4c88-a8fa-5191caf4adf6 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:38.331056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2704aa-02b9-4c88-a8fa-5191caf4adf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:38.331263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2704aa-02b9-4c88-a8fa-5191caf4adf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:38.342237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2704aa-02b9-4c88-a8fa-5191caf4adf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:38.343575 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2704aa-02b9-4c88-a8fa-5191caf4adf6 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:38.356764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 887/1779] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:38 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:38.358941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2704aa-02b9-4c88-a8fa-5191caf4adf6 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:38.360585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-fa2704aa-02b9-4c88-a8fa-5191caf4adf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:38.386643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2704aa-02b9-4c88-a8fa-5191caf4adf6 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:38.398087 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f22a3-90e6-4e65-a8d6-e1f179ffa190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:38.402025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f22a3-90e6-4e65-a8d6-e1f179ffa190 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:38.402025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f22a3-90e6-4e65-a8d6-e1f179ffa190 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:38.402025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f22a3-90e6-4e65-a8d6-e1f179ffa190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:38.410037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f22a3-90e6-4e65-a8d6-e1f179ffa190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:38.411670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f22a3-90e6-4e65-a8d6-e1f179ffa190 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:38.433849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 888/1780] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:38.434948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f22a3-90e6-4e65-a8d6-e1f179ffa190 service nova] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:38.436452 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6b5f22a3-90e6-4e65-a8d6-e1f179ffa190 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:38.451117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f22a3-90e6-4e65-a8d6-e1f179ffa190 service nova] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:38.455737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4072c07-51ac-4b76-a7e7-cd1caa75b9e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:38.456197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4072c07-51ac-4b76-a7e7-cd1caa75b9e3 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:38.456584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4072c07-51ac-4b76-a7e7-cd1caa75b9e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:38.456936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4072c07-51ac-4b76-a7e7-cd1caa75b9e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:38.469011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4072c07-51ac-4b76-a7e7-cd1caa75b9e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:38.470518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4072c07-51ac-4b76-a7e7-cd1caa75b9e3 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:38.483241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c386ad95b8834c65bb6280b826ea39fc'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:38.492630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 889/1781] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:38 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:38.520544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c386ad95b8834c65bb6280b826ea39fc'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:38.521652 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c386ad95b8834c65bb6280b826ea39fc'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:38.531596 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c386ad95b8834c65bb6280b826ea39fc'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:38.556113 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4072c07-51ac-4b76-a7e7-cd1caa75b9e3 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:38.570719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4072c07-51ac-4b76-a7e7-cd1caa75b9e3 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:38.581712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cec64-e414-4fa1-8e28-312659ca51c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:38.581712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cec64-e414-4fa1-8e28-312659ca51c9 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:38.581712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cec64-e414-4fa1-8e28-312659ca51c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:38.581712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cec64-e414-4fa1-8e28-312659ca51c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:38.623602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f1ab0638-5bbe-4024-b4b3-24c83a3a6548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c386ad95b8834c65bb6280b826ea39fc'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:38.637491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 893/1782] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:37 2021] DELETE /identity/v3/users/c386ad95b8834c65bb6280b826ea39fc => generated 0 bytes in 1542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:38.640946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275004-3910-4c80-ab6a-ceb29aa61c48 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:38.641515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275004-3910-4c80-ab6a-ceb29aa61c48 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:38.641868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275004-3910-4c80-ab6a-ceb29aa61c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:38.662483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-c5275004-3910-4c80-ab6a-ceb29aa61c48 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:38.663730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c5275004-3910-4c80-ab6a-ceb29aa61c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:38.696198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cec64-e414-4fa1-8e28-312659ca51c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:38.699094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cec64-e414-4fa1-8e28-312659ca51c9 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:38.729002 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 890/1783] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:38 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:38.802961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 894/1784] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:38.816265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cec64-e414-4fa1-8e28-312659ca51c9 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:38.817757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e17cec64-e414-4fa1-8e28-312659ca51c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:38.908345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cec64-e414-4fa1-8e28-312659ca51c9 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:38.952100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5275004-3910-4c80-ab6a-ceb29aa61c48 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:38.953298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c5275004-3910-4c80-ab6a-ceb29aa61c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:38.983432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70690d3-7f5e-4dc6-858a-628f330562f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:38.984399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70690d3-7f5e-4dc6-858a-628f330562f8 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:38.984805 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70690d3-7f5e-4dc6-858a-628f330562f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:38.985311 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70690d3-7f5e-4dc6-858a-628f330562f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:38.999092 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70690d3-7f5e-4dc6-858a-628f330562f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:39.001173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70690d3-7f5e-4dc6-858a-628f330562f8 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:39.013065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 891/1785] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:39.037943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5275004-3910-4c80-ab6a-ceb29aa61c48 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:39.042622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b4add-1da6-4b71-8bb3-074a83c9eb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:39.043426 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b4add-1da6-4b71-8bb3-074a83c9eb56 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:39.043784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b4add-1da6-4b71-8bb3-074a83c9eb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:39.044253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b4add-1da6-4b71-8bb3-074a83c9eb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:39.046583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ac5b4add-1da6-4b71-8bb3-074a83c9eb56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:39.164480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b4add-1da6-4b71-8bb3-074a83c9eb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:39.166559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b4add-1da6-4b71-8bb3-074a83c9eb56 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:39.184002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 895/1786] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:38 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:39.851289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70690d3-7f5e-4dc6-858a-628f330562f8 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:39.852320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d70690d3-7f5e-4dc6-858a-628f330562f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:39.869509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70690d3-7f5e-4dc6-858a-628f330562f8 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:39.876705 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:39.877968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:39.878524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:39.878986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] PATH_INFO: `/v3/projects/aea4ac4a8e2b4c499d81044f3ddedee4` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:39.881062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea4ac4a8e2b4c499d81044f3ddedee4)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:39.884273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:40.035745 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea4ac4a8e2b4c499d81044f3ddedee4', 'request_id': 'req-151a98ba-7d49-4623-acc5-80510a91ffd8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:40.143347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea4ac4a8e2b4c499d81044f3ddedee4', 'request_id': 'req-151a98ba-7d49-4623-acc5-80510a91ffd8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:40.149352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea4ac4a8e2b4c499d81044f3ddedee4', 'request_id': 'req-151a98ba-7d49-4623-acc5-80510a91ffd8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:40.161407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] The token cache is being invalidate because project aea4ac4a8e2b4c499d81044f3ddedee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:40.161784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:40.162511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-151a98ba-7d49-4623-acc5-80510a91ffd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:40.164071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 892/1787] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:39 2021] DELETE /identity/v3/projects/aea4ac4a8e2b4c499d81044f3ddedee4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:40.168742 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b4add-1da6-4b71-8bb3-074a83c9eb56 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:40.179649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b4add-1da6-4b71-8bb3-074a83c9eb56 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:40.239307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:40.240275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:40.240595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:40.240960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] PATH_INFO: `/v3/users/e3a4fd505af746fca2bc579dea60d268` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:40.242299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a4fd505af746fca2bc579dea60d268)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:40.244318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:40.478225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a4fd505af746fca2bc579dea60d268'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:40.493078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a4fd505af746fca2bc579dea60d268'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:40.494029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a4fd505af746fca2bc579dea60d268'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:40.505004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a4fd505af746fca2bc579dea60d268'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:40.543866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8008739-56f3-4f68-961e-80cc1ed94e50 None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:40.548433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8008739-56f3-4f68-961e-80cc1ed94e50 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:40.549295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8008739-56f3-4f68-961e-80cc1ed94e50 None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:40.553081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 893/1788] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 04:44:40 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:44:40.565234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567076b1-4ea0-4a43-b8a4-1b9d8bf40d7e None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:40.565654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567076b1-4ea0-4a43-b8a4-1b9d8bf40d7e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:40.566191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567076b1-4ea0-4a43-b8a4-1b9d8bf40d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:40.600200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-567076b1-4ea0-4a43-b8a4-1b9d8bf40d7e None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:40.603324 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a4fd505af746fca2bc579dea60d268'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:40.613938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-567076b1-4ea0-4a43-b8a4-1b9d8bf40d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:40.618787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 896/1789] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:40 2021] DELETE /identity/v3/users/e3a4fd505af746fca2bc579dea60d268 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:40.727919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 894/1790] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 04:44:40 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:40.883271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:40.883271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:40.900185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdd35a-3d4b-4930-9e9c-2672173c5b09 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:40.907966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960677f-2879-4dd7-a55f-919450c248b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:40.911510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960677f-2879-4dd7-a55f-919450c248b8 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:40.911510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960677f-2879-4dd7-a55f-919450c248b8 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:40.911510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960677f-2879-4dd7-a55f-919450c248b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:40.938698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960677f-2879-4dd7-a55f-919450c248b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:40.940194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960677f-2879-4dd7-a55f-919450c248b8 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:40.952585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 897/1791] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:41.226169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567076b1-4ea0-4a43-b8a4-1b9d8bf40d7e None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:41.228418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-567076b1-4ea0-4a43-b8a4-1b9d8bf40d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:41.298754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567076b1-4ea0-4a43-b8a4-1b9d8bf40d7e None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:41.303421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:41.304290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:41.304609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:41.304887 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] PATH_INFO: `/v3/projects/6c4bdb5af8c04deb9ac87fe648714812` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:41.306095 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4bdb5af8c04deb9ac87fe648714812)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:41.308107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:41.427468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4bdb5af8c04deb9ac87fe648714812', 'request_id': 'req-cd548719-52f1-45ec-adfe-f5978516e3c8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:41.524257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4bdb5af8c04deb9ac87fe648714812', 'request_id': 'req-cd548719-52f1-45ec-adfe-f5978516e3c8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:41.533817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4bdb5af8c04deb9ac87fe648714812', 'request_id': 'req-cd548719-52f1-45ec-adfe-f5978516e3c8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:41.549758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] The token cache is being invalidate because project 6c4bdb5af8c04deb9ac87fe648714812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:41.550059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:41.551328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd548719-52f1-45ec-adfe-f5978516e3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:41.553203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 895/1792] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:41 2021] DELETE /identity/v3/projects/6c4bdb5af8c04deb9ac87fe648714812 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:41.558862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f8463-94d4-4830-b6af-776e7d188c01 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:41.559410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f8463-94d4-4830-b6af-776e7d188c01 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:41.559410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f8463-94d4-4830-b6af-776e7d188c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:41.579901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a40f8463-94d4-4830-b6af-776e7d188c01 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:41.586380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a40f8463-94d4-4830-b6af-776e7d188c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:41.648342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 898/1793] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:41.659797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757d9ad-9c1e-4dbd-8e7b-7a07948ed2be None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:41.660091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757d9ad-9c1e-4dbd-8e7b-7a07948ed2be None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:41.660390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757d9ad-9c1e-4dbd-8e7b-7a07948ed2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:41.687539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b757d9ad-9c1e-4dbd-8e7b-7a07948ed2be None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:41.689597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b757d9ad-9c1e-4dbd-8e7b-7a07948ed2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:41.701633 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 896/1794] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:41.727059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f8463-94d4-4830-b6af-776e7d188c01 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:41.739082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f8463-94d4-4830-b6af-776e7d188c01 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:41.744086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13120a6-2df2-4f26-94bc-fa86e9535a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:41.744797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13120a6-2df2-4f26-94bc-fa86e9535a4a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:41.745083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13120a6-2df2-4f26-94bc-fa86e9535a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:41.745357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13120a6-2df2-4f26-94bc-fa86e9535a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:41.746230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13120a6-2df2-4f26-94bc-fa86e9535a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:41.746402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13120a6-2df2-4f26-94bc-fa86e9535a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:41.748736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13120a6-2df2-4f26-94bc-fa86e9535a4a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:41.770262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 899/1795] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:41.773594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757d9ad-9c1e-4dbd-8e7b-7a07948ed2be None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:41.783708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757d9ad-9c1e-4dbd-8e7b-7a07948ed2be None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:41.788375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13120a6-2df2-4f26-94bc-fa86e9535a4a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:41.789468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907f2ee-eda9-4a61-9a91-8ae0ad9367f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:41.790329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907f2ee-eda9-4a61-9a91-8ae0ad9367f5 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:41.790459 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b13120a6-2df2-4f26-94bc-fa86e9535a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:41.790609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907f2ee-eda9-4a61-9a91-8ae0ad9367f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:41.791069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907f2ee-eda9-4a61-9a91-8ae0ad9367f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:41.791852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907f2ee-eda9-4a61-9a91-8ae0ad9367f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:41.793857 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907f2ee-eda9-4a61-9a91-8ae0ad9367f5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:41.805706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13120a6-2df2-4f26-94bc-fa86e9535a4a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:41.813231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:41.814123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:41.814408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:41.814689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] PATH_INFO: `/v3/users/9faa8141d8b545c4861abee6c2e7a6d2` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:41.816117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9faa8141d8b545c4861abee6c2e7a6d2)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:41.818127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:41.944153 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 897/1796] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:41 2021] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:41.949161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907f2ee-eda9-4a61-9a91-8ae0ad9367f5 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:42.046146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907f2ee-eda9-4a61-9a91-8ae0ad9367f5 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:42.051490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b76bc4-6464-408b-b825-b0a4336dc405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:42.052187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b76bc4-6464-408b-b825-b0a4336dc405 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:42.052666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b76bc4-6464-408b-b825-b0a4336dc405 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:42.052955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b76bc4-6464-408b-b825-b0a4336dc405 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:42.054149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b76bc4-6464-408b-b825-b0a4336dc405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:42.055924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b76bc4-6464-408b-b825-b0a4336dc405 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:42.087836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9faa8141d8b545c4861abee6c2e7a6d2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:42.101932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9faa8141d8b545c4861abee6c2e7a6d2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:42.102782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9faa8141d8b545c4861abee6c2e7a6d2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:42.123278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9faa8141d8b545c4861abee6c2e7a6d2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:42.218276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-70a9e25e-41bf-4159-8b19-a48dfa02e801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9faa8141d8b545c4861abee6c2e7a6d2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:42.226560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 900/1797] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:41 2021] DELETE /identity/v3/users/9faa8141d8b545c4861abee6c2e7a6d2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:42.232277 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcec378-3e4a-4872-a040-12417e59f7b1 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:42.245165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcec378-3e4a-4872-a040-12417e59f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:42.245165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcec378-3e4a-4872-a040-12417e59f7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:42.245389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 898/1798] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:41 2021] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:42.248316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b76bc4-6464-408b-b825-b0a4336dc405 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:42.250337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-08b76bc4-6464-408b-b825-b0a4336dc405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:42.258568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ffcec378-3e4a-4872-a040-12417e59f7b1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:42.259779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ffcec378-3e4a-4872-a040-12417e59f7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:42.273258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b76bc4-6464-408b-b825-b0a4336dc405 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:42.344013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd938e-98d2-4657-87dc-6548b8a027b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:42.344785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd938e-98d2-4657-87dc-6548b8a027b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:42.345079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd938e-98d2-4657-87dc-6548b8a027b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:42.345358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd938e-98d2-4657-87dc-6548b8a027b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:42.346101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd938e-98d2-4657-87dc-6548b8a027b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:42.347889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd938e-98d2-4657-87dc-6548b8a027b7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:42.359216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 901/1799] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:42.362513 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 899/1800] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:42 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:42.364103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcec378-3e4a-4872-a040-12417e59f7b1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:42.370437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd938e-98d2-4657-87dc-6548b8a027b7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:42.372763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-68dd938e-98d2-4657-87dc-6548b8a027b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:42.376812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcec378-3e4a-4872-a040-12417e59f7b1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:42.382147 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d41103-eb5d-47dc-a4d2-44c99b2d17fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:42.382866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d41103-eb5d-47dc-a4d2-44c99b2d17fb admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:42.383217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d41103-eb5d-47dc-a4d2-44c99b2d17fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:42.383570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d41103-eb5d-47dc-a4d2-44c99b2d17fb admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:42.384314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d41103-eb5d-47dc-a4d2-44c99b2d17fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:42.386129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d41103-eb5d-47dc-a4d2-44c99b2d17fb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:42.397504 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 902/1801] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:42 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:42.403107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d41103-eb5d-47dc-a4d2-44c99b2d17fb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:42.425592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d41103-eb5d-47dc-a4d2-44c99b2d17fb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:42.435842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db1a9-f3ee-4dbe-ad30-5d865109738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:42.436772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db1a9-f3ee-4dbe-ad30-5d865109738f admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:42.437053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db1a9-f3ee-4dbe-ad30-5d865109738f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:42.437329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db1a9-f3ee-4dbe-ad30-5d865109738f admin admin] PATH_INFO: `/v3/projects/2204a38d939e42f5a34d3eb1c899d22a/users/6a9ebccb412840b596b9950aa78b257d/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:42.451730 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd938e-98d2-4657-87dc-6548b8a027b7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:42.454320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db1a9-f3ee-4dbe-ad30-5d865109738f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2204a38d939e42f5a34d3eb1c899d22a, user_id=6a9ebccb412840b596b9950aa78b257d, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:42.457381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db1a9-f3ee-4dbe-ad30-5d865109738f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:42.457749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a24c5-10f4-477f-b2ec-f23892274eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:42.458421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a24c5-10f4-477f-b2ec-f23892274eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:42.458726 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a24c5-10f4-477f-b2ec-f23892274eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:42.459121 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a24c5-10f4-477f-b2ec-f23892274eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:42.475315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a24c5-10f4-477f-b2ec-f23892274eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:42.477366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a24c5-10f4-477f-b2ec-f23892274eb5 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:42.488962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 900/1802] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:42.570574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 903/1803] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:42 2021] PUT /identity/v3/projects/2204a38d939e42f5a34d3eb1c899d22a/users/6a9ebccb412840b596b9950aa78b257d/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:42.581969 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004cd6-2bd4-417a-b6f9-cafa3b7e09a0 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:42.582312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004cd6-2bd4-417a-b6f9-cafa3b7e09a0 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:42.582545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004cd6-2bd4-417a-b6f9-cafa3b7e09a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:42.621377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-01004cd6-2bd4-417a-b6f9-cafa3b7e09a0 None None] MFA Rules not processed for user `6a9ebccb412840b596b9950aa78b257d`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:42.624988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-01004cd6-2bd4-417a-b6f9-cafa3b7e09a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:42.713845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 901/1804] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:42 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:42.719043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db1a9-f3ee-4dbe-ad30-5d865109738f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:42.822784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db1a9-f3ee-4dbe-ad30-5d865109738f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:42.832194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9df7bc-7c90-4517-a5c8-468c4fa6caa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:42.833435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9df7bc-7c90-4517-a5c8-468c4fa6caa8 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:42.833798 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9df7bc-7c90-4517-a5c8-468c4fa6caa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:42.834266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9df7bc-7c90-4517-a5c8-468c4fa6caa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:42.835483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9df7bc-7c90-4517-a5c8-468c4fa6caa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:42.840192 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9df7bc-7c90-4517-a5c8-468c4fa6caa8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:42.957831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 904/1805] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:42 2021] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:42.959120 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01004cd6-2bd4-417a-b6f9-cafa3b7e09a0 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:42.984201 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01004cd6-2bd4-417a-b6f9-cafa3b7e09a0 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:43.080021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe2054-248b-4b89-b63c-5fa3c19cf69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:43.081813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe2054-248b-4b89-b63c-5fa3c19cf69d admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:43.081813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe2054-248b-4b89-b63c-5fa3c19cf69d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:43.081813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe2054-248b-4b89-b63c-5fa3c19cf69d admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:43.081813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe2054-248b-4b89-b63c-5fa3c19cf69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:43.084249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe2054-248b-4b89-b63c-5fa3c19cf69d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:43.109529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9df7bc-7c90-4517-a5c8-468c4fa6caa8 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:43.111831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5a9df7bc-7c90-4517-a5c8-468c4fa6caa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:43.140986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9df7bc-7c90-4517-a5c8-468c4fa6caa8 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:43.172682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:43.173737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:43.176198 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:43.176625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] PATH_INFO: `/v3/projects/729eeb61015b408486d23db56734148e` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:43.180018 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729eeb61015b408486d23db56734148e)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:43.188042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:43.206598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 902/1806] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:42 2021] POST /identity/v3/users => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:43.210320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe2054-248b-4b89-b63c-5fa3c19cf69d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:43.237073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe2054-248b-4b89-b63c-5fa3c19cf69d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:43.249615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f01c4f-0656-43a1-ab3f-0e228bf189b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:43.252190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01c4f-0656-43a1-ab3f-0e228bf189b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:43.252926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01c4f-0656-43a1-ab3f-0e228bf189b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:43.257329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01c4f-0656-43a1-ab3f-0e228bf189b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:43.257329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f01c4f-0656-43a1-ab3f-0e228bf189b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:43.257980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f01c4f-0656-43a1-ab3f-0e228bf189b3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:43.273376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 903/1807] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:43.278123 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f01c4f-0656-43a1-ab3f-0e228bf189b3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:43.291504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f01c4f-0656-43a1-ab3f-0e228bf189b3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:43.299720 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b05c3-e5fa-4c25-97a5-e455073f8a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:43.300948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b05c3-e5fa-4c25-97a5-e455073f8a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:43.309656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b05c3-e5fa-4c25-97a5-e455073f8a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:43.309656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b05c3-e5fa-4c25-97a5-e455073f8a69 admin admin] PATH_INFO: `/v3/projects/9541d329e1174bfdbc7d07674e92c040/users/715c19e85af24c3a94fd1014d3ff29de/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:43.331320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b05c3-e5fa-4c25-97a5-e455073f8a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9541d329e1174bfdbc7d07674e92c040, user_id=715c19e85af24c3a94fd1014d3ff29de, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:43.335290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b05c3-e5fa-4c25-97a5-e455073f8a69 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:43.494528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 904/1808] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:43 2021] PUT /identity/v3/projects/9541d329e1174bfdbc7d07674e92c040/users/715c19e85af24c3a94fd1014d3ff29de/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:43.498938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b05c3-e5fa-4c25-97a5-e455073f8a69 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:43.521186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729eeb61015b408486d23db56734148e', 'request_id': 'req-fa90e922-01d6-4f49-b320-457020c69c06'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:43.537201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729eeb61015b408486d23db56734148e', 'request_id': 'req-fa90e922-01d6-4f49-b320-457020c69c06'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:43.544850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729eeb61015b408486d23db56734148e', 'request_id': 'req-fa90e922-01d6-4f49-b320-457020c69c06'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:43.623760 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b05c3-e5fa-4c25-97a5-e455073f8a69 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:43.699421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68311e-6b2b-4382-b344-5b07da81be51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:43.700774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68311e-6b2b-4382-b344-5b07da81be51 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:43.701011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68311e-6b2b-4382-b344-5b07da81be51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:43.701294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68311e-6b2b-4382-b344-5b07da81be51 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:43.702041 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68311e-6b2b-4382-b344-5b07da81be51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:43.703682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68311e-6b2b-4382-b344-5b07da81be51 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:43.705164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] The token cache is being invalidate because project 729eeb61015b408486d23db56734148e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:43.705699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:43.707055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:43.709928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 905/1809] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:43 2021] DELETE /identity/v3/projects/729eeb61015b408486d23db56734148e => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:43.714792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 905/1810] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:43.717223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68311e-6b2b-4382-b344-5b07da81be51 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:43.719224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-bf68311e-6b2b-4382-b344-5b07da81be51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:43.720074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:43.722659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:43.734688 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68311e-6b2b-4382-b344-5b07da81be51 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:43.743134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:43.745309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:43.745611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:43.745893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] PATH_INFO: `/v3/users/e08d58e10f654919acac590029274f28` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:43.746866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90e922-01d6-4f49-b320-457020c69c06 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:43.747456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08d58e10f654919acac590029274f28)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:43.749795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:43.755658 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b355b8-b2a9-4a10-bc14-baa37e6628ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:43.756750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b355b8-b2a9-4a10-bc14-baa37e6628ae admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:43.757034 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b355b8-b2a9-4a10-bc14-baa37e6628ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:43.757465 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b355b8-b2a9-4a10-bc14-baa37e6628ae admin admin] PATH_INFO: `/v3/projects/9541d329e1174bfdbc7d07674e92c040/users/715c19e85af24c3a94fd1014d3ff29de/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:43.760336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b355b8-b2a9-4a10-bc14-baa37e6628ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9541d329e1174bfdbc7d07674e92c040, user_id=715c19e85af24c3a94fd1014d3ff29de, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:43.764009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b355b8-b2a9-4a10-bc14-baa37e6628ae admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:43.775691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 906/1811] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:43 2021] PUT /identity/v3/projects/9541d329e1174bfdbc7d07674e92c040/users/715c19e85af24c3a94fd1014d3ff29de/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:43.776580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b355b8-b2a9-4a10-bc14-baa37e6628ae admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:43.778221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f0b355b8-b2a9-4a10-bc14-baa37e6628ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:43.849744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b355b8-b2a9-4a10-bc14-baa37e6628ae admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:43.854730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:43.856068 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:43.856420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:43.856707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] PATH_INFO: `/v3/users/18a580b0890842c888877a18f07e8b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:43.858075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a580b0890842c888877a18f07e8b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:43.860099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:44.031438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08d58e10f654919acac590029274f28'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.031438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08d58e10f654919acac590029274f28'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.031438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08d58e10f654919acac590029274f28'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.044905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08d58e10f654919acac590029274f28'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.110546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a580b0890842c888877a18f07e8b05'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.125157 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a580b0890842c888877a18f07e8b05'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.134721 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a580b0890842c888877a18f07e8b05'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.134721 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a580b0890842c888877a18f07e8b05'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.183189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-98eef222-ac2a-48e4-9eb2-06ec4a66952a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08d58e10f654919acac590029274f28'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.198101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 906/1812] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:43 2021] DELETE /identity/v3/users/e08d58e10f654919acac590029274f28 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:44.202234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc2419-fc35-4a7c-b0f9-a06c7aca0159 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.202234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc2419-fc35-4a7c-b0f9-a06c7aca0159 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.202234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc2419-fc35-4a7c-b0f9-a06c7aca0159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.236409 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b5dc2419-fc35-4a7c-b0f9-a06c7aca0159 None None] MFA Rules not processed for user `715c19e85af24c3a94fd1014d3ff29de`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:44.237844 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b5dc2419-fc35-4a7c-b0f9-a06c7aca0159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:44.302106 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7a22d00-3eb3-4ba2-8370-36627b251f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a580b0890842c888877a18f07e8b05'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.317881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 907/1813] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:43 2021] DELETE /identity/v3/users/18a580b0890842c888877a18f07e8b05 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:44.322768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d6768-87d8-4d30-8b8a-b12d695c13b2 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.323207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d6768-87d8-4d30-8b8a-b12d695c13b2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.324273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d6768-87d8-4d30-8b8a-b12d695c13b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.360693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 907/1814] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:44 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:44.361392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-9a9d6768-87d8-4d30-8b8a-b12d695c13b2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:44.362376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9a9d6768-87d8-4d30-8b8a-b12d695c13b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:44.380935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc2419-fc35-4a7c-b0f9-a06c7aca0159 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:44.382779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b5dc2419-fc35-4a7c-b0f9-a06c7aca0159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:44.477022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc2419-fc35-4a7c-b0f9-a06c7aca0159 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:44.488418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 908/1815] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:44.509529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d6768-87d8-4d30-8b8a-b12d695c13b2 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:44.511041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9a9d6768-87d8-4d30-8b8a-b12d695c13b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:44.595642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d643-fca3-43ce-bdec-cdc098f00c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:44.598934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d643-fca3-43ce-bdec-cdc098f00c57 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.599556 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d643-fca3-43ce-bdec-cdc098f00c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.601119 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d643-fca3-43ce-bdec-cdc098f00c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.615477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d6768-87d8-4d30-8b8a-b12d695c13b2 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:44.619698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aba050-faba-4ac3-b97f-5b3b9355cead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:44.620450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aba050-faba-4ac3-b97f-5b3b9355cead service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.620687 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aba050-faba-4ac3-b97f-5b3b9355cead service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.620966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aba050-faba-4ac3-b97f-5b3b9355cead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.634063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aba050-faba-4ac3-b97f-5b3b9355cead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:44.636473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aba050-faba-4ac3-b97f-5b3b9355cead service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:44.668063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 909/1816] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:44.750799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617d643-fca3-43ce-bdec-cdc098f00c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:44.752785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617d643-fca3-43ce-bdec-cdc098f00c57 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:44.782303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 908/1817] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:44 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:44.856057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aba050-faba-4ac3-b97f-5b3b9355cead service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:44.858248 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-38aba050-faba-4ac3-b97f-5b3b9355cead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:44.871128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aba050-faba-4ac3-b97f-5b3b9355cead service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:44.875690 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:44.876605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.876885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.877156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] PATH_INFO: `/v3/users/6a9ebccb412840b596b9950aa78b257d` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.878565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9ebccb412840b596b9950aa78b257d)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:44.880526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:44.957731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d643-fca3-43ce-bdec-cdc098f00c57 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:44.959494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7617d643-fca3-43ce-bdec-cdc098f00c57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:44.982047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d643-fca3-43ce-bdec-cdc098f00c57 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:44.989702 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:44.991029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.991426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.991908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] PATH_INFO: `/v3/projects/2387c4e562ef4792ad9f550e227d7911` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.993525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=2387c4e562ef4792ad9f550e227d7911)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:44.995778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.201764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2387c4e562ef4792ad9f550e227d7911', 'request_id': 'req-c4817bc1-8f67-403e-b0c1-e340b8e492ed'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.202489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9ebccb412840b596b9950aa78b257d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.216531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9ebccb412840b596b9950aa78b257d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.217402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9ebccb412840b596b9950aa78b257d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.225273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9ebccb412840b596b9950aa78b257d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.308457 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2387c4e562ef4792ad9f550e227d7911', 'request_id': 'req-c4817bc1-8f67-403e-b0c1-e340b8e492ed'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.314943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2387c4e562ef4792ad9f550e227d7911', 'request_id': 'req-c4817bc1-8f67-403e-b0c1-e340b8e492ed'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.325833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] The token cache is being invalidate because project 2387c4e562ef4792ad9f550e227d7911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:45.326124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.326768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c4817bc1-8f67-403e-b0c1-e340b8e492ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.328338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 909/1818] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:44 2021] DELETE /identity/v3/projects/2387c4e562ef4792ad9f550e227d7911 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:45.334349 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffa2f-7c4a-4f5f-b429-9d9b6e77c6b4 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.334640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffa2f-7c4a-4f5f-b429-9d9b6e77c6b4 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.334928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffa2f-7c4a-4f5f-b429-9d9b6e77c6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.362864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-eddffa2f-7c4a-4f5f-b429-9d9b6e77c6b4 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:45.364118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-eddffa2f-7c4a-4f5f-b429-9d9b6e77c6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:45.371868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9ebccb412840b596b9950aa78b257d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.383012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 910/1819] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:44 2021] DELETE /identity/v3/users/6a9ebccb412840b596b9950aa78b257d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:45.383012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:45.384722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:45.447802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 910/1820] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:45.450328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cc94e-6a9d-4fed-a377-f5e9914a3640 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.450819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cc94e-6a9d-4fed-a377-f5e9914a3640 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.451300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cc94e-6a9d-4fed-a377-f5e9914a3640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.470108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04a5fd-45a5-4e62-b10a-ac0f6feb13d5 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:45.473138 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-125cc94e-6a9d-4fed-a377-f5e9914a3640 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:45.474391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-125cc94e-6a9d-4fed-a377-f5e9914a3640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:45.478891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:45.480466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.480847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.481185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] PATH_INFO: `/v3/projects/12fb214082ac412081e6b3fa6201f949` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.483422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fb214082ac412081e6b3fa6201f949)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:45.485560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 911/1821] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:45.487087 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55a0ae-fae6-4303-8132-27b5310a2b4a None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.487628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55a0ae-fae6-4303-8132-27b5310a2b4a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.487910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55a0ae-fae6-4303-8132-27b5310a2b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.489964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.508666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0d55a0ae-fae6-4303-8132-27b5310a2b4a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:45.509767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0d55a0ae-fae6-4303-8132-27b5310a2b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:45.518899 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 912/1822] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:45.519546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55a0ae-fae6-4303-8132-27b5310a2b4a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:45.520889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0d55a0ae-fae6-4303-8132-27b5310a2b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:45.579962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55a0ae-fae6-4303-8132-27b5310a2b4a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:45.584570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d315eb-7333-4d96-82d2-04bcf86222cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:45.585233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d315eb-7333-4d96-82d2-04bcf86222cf service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.585517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d315eb-7333-4d96-82d2-04bcf86222cf service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.585791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d315eb-7333-4d96-82d2-04bcf86222cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.596891 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d315eb-7333-4d96-82d2-04bcf86222cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:45.598258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d315eb-7333-4d96-82d2-04bcf86222cf service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.601439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fb214082ac412081e6b3fa6201f949', 'request_id': 'req-49738eac-3b13-4b4f-b703-1d7a34febf45'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.608400 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fb214082ac412081e6b3fa6201f949', 'request_id': 'req-49738eac-3b13-4b4f-b703-1d7a34febf45'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.609432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 913/1823] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:45.610317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d315eb-7333-4d96-82d2-04bcf86222cf service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:45.614492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fb214082ac412081e6b3fa6201f949', 'request_id': 'req-49738eac-3b13-4b4f-b703-1d7a34febf45'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.620150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d315eb-7333-4d96-82d2-04bcf86222cf service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:45.678686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] The token cache is being invalidate because project 12fb214082ac412081e6b3fa6201f949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:45.678994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.679834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:45.682781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 911/1824] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:45 2021] DELETE /identity/v3/projects/12fb214082ac412081e6b3fa6201f949 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:45.684324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb116-ce0b-4d1c-be75-b8470a22c42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:45.685054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb116-ce0b-4d1c-be75-b8470a22c42c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.685338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb116-ce0b-4d1c-be75-b8470a22c42c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.685618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb116-ce0b-4d1c-be75-b8470a22c42c admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.686353 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eb116-ce0b-4d1c-be75-b8470a22c42c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:45.686661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eb116-ce0b-4d1c-be75-b8470a22c42c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:45.687492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:45.688375 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eb116-ce0b-4d1c-be75-b8470a22c42c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.689041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:45.705888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 914/1825] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:45.709926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49738eac-3b13-4b4f-b703-1d7a34febf45 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:45.710255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb116-ce0b-4d1c-be75-b8470a22c42c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:45.712475 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a05eb116-ce0b-4d1c-be75-b8470a22c42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:45.717388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:45.718426 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.719134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.719630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] PATH_INFO: `/v3/users/d113f0887498440cbf40c7b4d52709ff` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.721063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d113f0887498440cbf40c7b4d52709ff)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:45.723481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.727276 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb116-ce0b-4d1c-be75-b8470a22c42c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:45.733802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607f662-79ca-463e-a6dc-8eb9d09e612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:45.734662 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607f662-79ca-463e-a6dc-8eb9d09e612d admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.735065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607f662-79ca-463e-a6dc-8eb9d09e612d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.735582 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607f662-79ca-463e-a6dc-8eb9d09e612d admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.736595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607f662-79ca-463e-a6dc-8eb9d09e612d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:45.739655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607f662-79ca-463e-a6dc-8eb9d09e612d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.934128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 915/1826] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:45 2021] POST /identity/v3/projects => generated 407 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:45.938372 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607f662-79ca-463e-a6dc-8eb9d09e612d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.029442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607f662-79ca-463e-a6dc-8eb9d09e612d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.033585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd113f0887498440cbf40c7b4d52709ff'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.035556 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc0cac-6d65-4b5c-947a-9c8f6350f9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.036100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0cac-6d65-4b5c-947a-9c8f6350f9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.036616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0cac-6d65-4b5c-947a-9c8f6350f9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.036972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0cac-6d65-4b5c-947a-9c8f6350f9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.037741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc0cac-6d65-4b5c-947a-9c8f6350f9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.040056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc0cac-6d65-4b5c-947a-9c8f6350f9f3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.052290 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd113f0887498440cbf40c7b4d52709ff'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.055614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd113f0887498440cbf40c7b4d52709ff'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.060947 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd113f0887498440cbf40c7b4d52709ff'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.152376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 916/1827] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:45 2021] POST /identity/v3/users => generated 304 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:46.157163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc0cac-6d65-4b5c-947a-9c8f6350f9f3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.168697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc0cac-6d65-4b5c-947a-9c8f6350f9f3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.173540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96815f-caa4-4b86-8df2-6ba139e4a62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.174228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96815f-caa4-4b86-8df2-6ba139e4a62b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.174511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96815f-caa4-4b86-8df2-6ba139e4a62b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.174788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96815f-caa4-4b86-8df2-6ba139e4a62b admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.175549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96815f-caa4-4b86-8df2-6ba139e4a62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.177258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96815f-caa4-4b86-8df2-6ba139e4a62b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.177489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd113f0887498440cbf40c7b4d52709ff'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.187924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 912/1828] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:45 2021] DELETE /identity/v3/users/d113f0887498440cbf40c7b4d52709ff => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:46.192451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 917/1829] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:46 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:46.192714 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.193540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96815f-caa4-4b86-8df2-6ba139e4a62b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.195491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3e96815f-caa4-4b86-8df2-6ba139e4a62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:46.195771 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:46.223457 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96815f-caa4-4b86-8df2-6ba139e4a62b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.286808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284fd14-9a39-4619-8ecf-c2bddd42bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.287654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284fd14-9a39-4619-8ecf-c2bddd42bf7e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.287936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284fd14-9a39-4619-8ecf-c2bddd42bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.288205 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284fd14-9a39-4619-8ecf-c2bddd42bf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.288989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284fd14-9a39-4619-8ecf-c2bddd42bf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.290908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284fd14-9a39-4619-8ecf-c2bddd42bf7e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.301296 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 918/1830] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:46 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:46.306242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284fd14-9a39-4619-8ecf-c2bddd42bf7e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.313664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095ab01-7286-477c-96f2-461b06d999d9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.315974 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284fd14-9a39-4619-8ecf-c2bddd42bf7e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.319800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.320696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea119a-3d5f-4a34-b716-b8bc2c95e0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.321061 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.321461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.321616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea119a-3d5f-4a34-b716-b8bc2c95e0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.321838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea119a-3d5f-4a34-b716-b8bc2c95e0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.322114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea119a-3d5f-4a34-b716-b8bc2c95e0ff admin admin] PATH_INFO: `/v3/projects/23e701bc18614219a453416ea7dd8fc6/users/3ccf3680c2ae4e24a044adb3a69ada77/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.322221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] PATH_INFO: `/v3/projects/2204a38d939e42f5a34d3eb1c899d22a` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.323815 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2204a38d939e42f5a34d3eb1c899d22a)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.327373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.337114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea119a-3d5f-4a34-b716-b8bc2c95e0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e701bc18614219a453416ea7dd8fc6, user_id=3ccf3680c2ae4e24a044adb3a69ada77, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.339771 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea119a-3d5f-4a34-b716-b8bc2c95e0ff admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.441178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 919/1831] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:46 2021] PUT /identity/v3/projects/23e701bc18614219a453416ea7dd8fc6/users/3ccf3680c2ae4e24a044adb3a69ada77/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:46.451760 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6394-b8c6-48aa-9d70-ee3778223a61 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.452050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6394-b8c6-48aa-9d70-ee3778223a61 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.452530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6394-b8c6-48aa-9d70-ee3778223a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.477342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2204a38d939e42f5a34d3eb1c899d22a', 'request_id': 'req-9949f358-ce6f-497f-b582-10ac8a41a2c2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.479235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-4b9e6394-b8c6-48aa-9d70-ee3778223a61 None None] MFA Rules not processed for user `3ccf3680c2ae4e24a044adb3a69ada77`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:46.480497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4b9e6394-b8c6-48aa-9d70-ee3778223a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:46.484663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2204a38d939e42f5a34d3eb1c899d22a', 'request_id': 'req-9949f358-ce6f-497f-b582-10ac8a41a2c2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.491549 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2204a38d939e42f5a34d3eb1c899d22a', 'request_id': 'req-9949f358-ce6f-497f-b582-10ac8a41a2c2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.545990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 920/1832] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:46 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:46.550644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e6394-b8c6-48aa-9d70-ee3778223a61 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.559153 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] The token cache is being invalidate because project 2204a38d939e42f5a34d3eb1c899d22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:46.560101 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.560834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.562795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 913/1833] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:46 2021] DELETE /identity/v3/projects/2204a38d939e42f5a34d3eb1c899d22a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:46.566334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.567671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:46.625303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e6394-b8c6-48aa-9d70-ee3778223a61 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.634354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da3e09-6841-4967-b90e-c1566853cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.634354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da3e09-6841-4967-b90e-c1566853cc5b admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.634958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da3e09-6841-4967-b90e-c1566853cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.635089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949f358-ce6f-497f-b582-10ac8a41a2c2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.635342 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da3e09-6841-4967-b90e-c1566853cc5b admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.636226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da3e09-6841-4967-b90e-c1566853cc5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.638666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da3e09-6841-4967-b90e-c1566853cc5b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.642454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.643336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.643711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.643895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] PATH_INFO: `/v3/users/715c19e85af24c3a94fd1014d3ff29de` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.645163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=715c19e85af24c3a94fd1014d3ff29de)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.647197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.755730 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 921/1834] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:46 2021] POST /identity/v3/projects => generated 409 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:46.756827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da3e09-6841-4967-b90e-c1566853cc5b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.760709 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-64da3e09-6841-4967-b90e-c1566853cc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:46.826051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da3e09-6841-4967-b90e-c1566853cc5b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.830954 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.831817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.832096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.832393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] PATH_INFO: `/v3/projects/7713b928555a4e4986b4dd278c5db6b7` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.833605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7713b928555a4e4986b4dd278c5db6b7)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.835542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.876960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715c19e85af24c3a94fd1014d3ff29de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.891518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715c19e85af24c3a94fd1014d3ff29de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.892330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715c19e85af24c3a94fd1014d3ff29de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.900827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715c19e85af24c3a94fd1014d3ff29de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.967033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7713b928555a4e4986b4dd278c5db6b7', 'request_id': 'req-d583c597-3013-4667-be1d-c6b416f60670'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.981807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715c19e85af24c3a94fd1014d3ff29de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:46.992923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 914/1835] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:46 2021] DELETE /identity/v3/users/715c19e85af24c3a94fd1014d3ff29de => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:46.994605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.996618 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:47.057159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7713b928555a4e4986b4dd278c5db6b7', 'request_id': 'req-d583c597-3013-4667-be1d-c6b416f60670'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:47.065044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7713b928555a4e4986b4dd278c5db6b7', 'request_id': 'req-d583c597-3013-4667-be1d-c6b416f60670'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:47.078633 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] The token cache is being invalidate because project 7713b928555a4e4986b4dd278c5db6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:47.079270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:47.080398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:47.082755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 922/1836] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:46 2021] DELETE /identity/v3/projects/7713b928555a4e4986b4dd278c5db6b7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:47.087269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:47.089436 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:47.090293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632618-3037-464d-9892-fc31daeb0fba admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:47.111993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbdd37-0f17-4350-8c67-ac203fc2b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:47.113040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbdd37-0f17-4350-8c67-ac203fc2b52f admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.113451 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbdd37-0f17-4350-8c67-ac203fc2b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.113737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbdd37-0f17-4350-8c67-ac203fc2b52f admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.114640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbdd37-0f17-4350-8c67-ac203fc2b52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.116955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbdd37-0f17-4350-8c67-ac203fc2b52f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.175726 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c597-3013-4667-be1d-c6b416f60670 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:47.180761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:47.181642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.181928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.182209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] PATH_INFO: `/v3/users/b966dca533514c59b5b93c3a4027bcf8` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.183466 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b966dca533514c59b5b93c3a4027bcf8)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.185558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.204731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 915/1837] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:46 2021] POST /identity/v3/users => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:47.215102 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbdd37-0f17-4350-8c67-ac203fc2b52f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:47.218726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-babbdd37-0f17-4350-8c67-ac203fc2b52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:47.232803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbdd37-0f17-4350-8c67-ac203fc2b52f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:47.242974 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f236e-a957-4b93-bca3-6e60c7ce90ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:47.243687 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f236e-a957-4b93-bca3-6e60c7ce90ab admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.243974 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f236e-a957-4b93-bca3-6e60c7ce90ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.244289 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f236e-a957-4b93-bca3-6e60c7ce90ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.245146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f236e-a957-4b93-bca3-6e60c7ce90ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.246885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f236e-a957-4b93-bca3-6e60c7ce90ab admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.264405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 916/1838] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:47 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:47.269301 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f236e-a957-4b93-bca3-6e60c7ce90ab admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:47.281175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f236e-a957-4b93-bca3-6e60c7ce90ab admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:47.286383 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28cf4-23d3-427b-9b09-4285a3db71c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:47.287279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28cf4-23d3-427b-9b09-4285a3db71c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.287568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28cf4-23d3-427b-9b09-4285a3db71c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.287848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28cf4-23d3-427b-9b09-4285a3db71c3 admin admin] PATH_INFO: `/v3/projects/2abc46e8b57f4ef48546d8612b3bb7f5/users/ec28195226bd4e459f039082c441c6d8/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.304886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28cf4-23d3-427b-9b09-4285a3db71c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abc46e8b57f4ef48546d8612b3bb7f5, user_id=ec28195226bd4e459f039082c441c6d8, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.307563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28cf4-23d3-427b-9b09-4285a3db71c3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.395361 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 917/1839] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:47 2021] PUT /identity/v3/projects/2abc46e8b57f4ef48546d8612b3bb7f5/users/ec28195226bd4e459f039082c441c6d8/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:47.399125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28cf4-23d3-427b-9b09-4285a3db71c3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:47.430676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b966dca533514c59b5b93c3a4027bcf8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:47.431534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b966dca533514c59b5b93c3a4027bcf8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:47.432687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b966dca533514c59b5b93c3a4027bcf8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:47.445734 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b966dca533514c59b5b93c3a4027bcf8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:47.471378 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28cf4-23d3-427b-9b09-4285a3db71c3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:47.476328 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44c0c1-8271-4c81-8cd8-3d19066d4111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:47.477044 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44c0c1-8271-4c81-8cd8-3d19066d4111 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.477331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44c0c1-8271-4c81-8cd8-3d19066d4111 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.477608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44c0c1-8271-4c81-8cd8-3d19066d4111 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.478342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44c0c1-8271-4c81-8cd8-3d19066d4111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.479960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44c0c1-8271-4c81-8cd8-3d19066d4111 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.490322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 918/1840] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:47 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:47.494411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44c0c1-8271-4c81-8cd8-3d19066d4111 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:47.496146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0b44c0c1-8271-4c81-8cd8-3d19066d4111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:47.508473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44c0c1-8271-4c81-8cd8-3d19066d4111 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:47.513578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075922d-7bd6-4c42-a260-2d9f468ade40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:47.514438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075922d-7bd6-4c42-a260-2d9f468ade40 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.514721 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075922d-7bd6-4c42-a260-2d9f468ade40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.514997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075922d-7bd6-4c42-a260-2d9f468ade40 admin admin] PATH_INFO: `/v3/projects/2abc46e8b57f4ef48546d8612b3bb7f5/users/ec28195226bd4e459f039082c441c6d8/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.520706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075922d-7bd6-4c42-a260-2d9f468ade40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abc46e8b57f4ef48546d8612b3bb7f5, user_id=ec28195226bd4e459f039082c441c6d8, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.523404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075922d-7bd6-4c42-a260-2d9f468ade40 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.534981 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 919/1841] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:47 2021] PUT /identity/v3/projects/2abc46e8b57f4ef48546d8612b3bb7f5/users/ec28195226bd4e459f039082c441c6d8/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:47.545461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a922-9392-4829-b7b5-e503af71851e None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.545767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a922-9392-4829-b7b5-e503af71851e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.546044 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a922-9392-4829-b7b5-e503af71851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.548855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b966dca533514c59b5b93c3a4027bcf8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:47.567001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 923/1842] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:44:47 2021] DELETE /identity/v3/users/b966dca533514c59b5b93c3a4027bcf8 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:47.575935 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a0f7a922-9392-4829-b7b5-e503af71851e None None] MFA Rules not processed for user `ec28195226bd4e459f039082c441c6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:47.577496 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a0f7a922-9392-4829-b7b5-e503af71851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:47.586879 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:47.589280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:47.667572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 920/1843] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:47 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:47.670163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3649-f5b5-4b00-bfea-861cb6a4acb2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:47.678827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a922-9392-4829-b7b5-e503af71851e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:47.680371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a0f7a922-9392-4829-b7b5-e503af71851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:47.685361 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:47.686524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.687539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.687984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] PATH_INFO: `/v3/projects/9541d329e1174bfdbc7d07674e92c040` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.690566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9541d329e1174bfdbc7d07674e92c040)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.692857 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.746117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a922-9392-4829-b7b5-e503af71851e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:47.749871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de237285-c239-4a42-ba73-72c9b15dbbfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:47.750516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de237285-c239-4a42-ba73-72c9b15dbbfc service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.750800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de237285-c239-4a42-ba73-72c9b15dbbfc service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.751079 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de237285-c239-4a42-ba73-72c9b15dbbfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.760118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de237285-c239-4a42-ba73-72c9b15dbbfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.763196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de237285-c239-4a42-ba73-72c9b15dbbfc service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.775387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 921/1844] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:47 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:47.909752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9541d329e1174bfdbc7d07674e92c040', 'request_id': 'req-0393e0fa-fea3-477b-8113-3aefc75a928b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:48.035532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9541d329e1174bfdbc7d07674e92c040', 'request_id': 'req-0393e0fa-fea3-477b-8113-3aefc75a928b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:48.043639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9541d329e1174bfdbc7d07674e92c040', 'request_id': 'req-0393e0fa-fea3-477b-8113-3aefc75a928b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:48.060308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] The token cache is being invalidate because project 9541d329e1174bfdbc7d07674e92c040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:48.060647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:48.061560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0393e0fa-fea3-477b-8113-3aefc75a928b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:48.067272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 924/1845] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:47 2021] DELETE /identity/v3/projects/9541d329e1174bfdbc7d07674e92c040 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:48.069774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d360-f7ba-4e87-a698-fc25105951da None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.072532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d360-f7ba-4e87-a698-fc25105951da None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.072532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d360-f7ba-4e87-a698-fc25105951da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.093512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-5ba5d360-f7ba-4e87-a698-fc25105951da None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:48.094800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5ba5d360-f7ba-4e87-a698-fc25105951da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:48.187495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 922/1846] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:48.201965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dc8c8-1b5c-4da4-97b3-a383d32ef754 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.212750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dc8c8-1b5c-4da4-97b3-a383d32ef754 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.213118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dc8c8-1b5c-4da4-97b3-a383d32ef754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.220659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d360-f7ba-4e87-a698-fc25105951da None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:48.223211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5ba5d360-f7ba-4e87-a698-fc25105951da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:48.251898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-ee1dc8c8-1b5c-4da4-97b3-a383d32ef754 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:48.254446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ee1dc8c8-1b5c-4da4-97b3-a383d32ef754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:48.269583 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 925/1847] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:48.276181 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dc8c8-1b5c-4da4-97b3-a383d32ef754 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:48.314202 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dc8c8-1b5c-4da4-97b3-a383d32ef754 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:48.326495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d360-f7ba-4e87-a698-fc25105951da None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:48.331206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4b66c-3c5e-4c24-a09f-8335a0669642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:48.331883 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4b66c-3c5e-4c24-a09f-8335a0669642 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.332213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4b66c-3c5e-4c24-a09f-8335a0669642 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.332777 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4b66c-3c5e-4c24-a09f-8335a0669642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.336531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-63d4b66c-3c5e-4c24-a09f-8335a0669642 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:48.340262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0b129-066a-4357-8c8a-6a1f44656654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:48.341943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0b129-066a-4357-8c8a-6a1f44656654 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.342632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0b129-066a-4357-8c8a-6a1f44656654 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.343552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0b129-066a-4357-8c8a-6a1f44656654 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.345613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0b129-066a-4357-8c8a-6a1f44656654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:48.354316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0b129-066a-4357-8c8a-6a1f44656654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:48.354316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0b129-066a-4357-8c8a-6a1f44656654 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:48.366439 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 926/1848] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:44:48.367666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0b129-066a-4357-8c8a-6a1f44656654 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:48.374231 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5ca0b129-066a-4357-8c8a-6a1f44656654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:48.394310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0b129-066a-4357-8c8a-6a1f44656654 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:48.399586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:48.400484 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.400771 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.401046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] PATH_INFO: `/v3/projects/065cdc69cce343e7bcbc76dc179b16ec` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.402308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=065cdc69cce343e7bcbc76dc179b16ec)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:48.404272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:48.427083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4b66c-3c5e-4c24-a09f-8335a0669642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:48.429153 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4b66c-3c5e-4c24-a09f-8335a0669642 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:48.441308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 923/1849] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:48 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:48.442261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4b66c-3c5e-4c24-a09f-8335a0669642 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:48.456506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4b66c-3c5e-4c24-a09f-8335a0669642 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:48.462303 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d203f0-b90f-4bcb-bd1f-22f44cda1940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:48.463231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d203f0-b90f-4bcb-bd1f-22f44cda1940 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.463609 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d203f0-b90f-4bcb-bd1f-22f44cda1940 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.464048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d203f0-b90f-4bcb-bd1f-22f44cda1940 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.465127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d203f0-b90f-4bcb-bd1f-22f44cda1940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:48.469191 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d203f0-b90f-4bcb-bd1f-22f44cda1940 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:48.558011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065cdc69cce343e7bcbc76dc179b16ec', 'request_id': 'req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:48.639509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 924/1850] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:48 2021] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:48.641082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d203f0-b90f-4bcb-bd1f-22f44cda1940 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:48.683167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065cdc69cce343e7bcbc76dc179b16ec', 'request_id': 'req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:48.691921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065cdc69cce343e7bcbc76dc179b16ec', 'request_id': 'req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:48.717049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] The token cache is being invalidate because project 065cdc69cce343e7bcbc76dc179b16ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:48.718534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:48.719425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b2eddd3f-de29-45af-8f8e-6d67c0103f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:48.722407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 927/1851] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:44:48 2021] DELETE /identity/v3/projects/065cdc69cce343e7bcbc76dc179b16ec => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:48.730528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19110771-cae7-45ca-8e16-85e8f6aedb06 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.730759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19110771-cae7-45ca-8e16-85e8f6aedb06 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.731147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19110771-cae7-45ca-8e16-85e8f6aedb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.751373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d203f0-b90f-4bcb-bd1f-22f44cda1940 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:48.751816 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-19110771-cae7-45ca-8e16-85e8f6aedb06 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:48.753307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-19110771-cae7-45ca-8e16-85e8f6aedb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:48.756625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62726a2-a74d-468b-98aa-eecfe793f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:48.757670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62726a2-a74d-468b-98aa-eecfe793f6ff admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.757784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62726a2-a74d-468b-98aa-eecfe793f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.757998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62726a2-a74d-468b-98aa-eecfe793f6ff admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.758847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62726a2-a74d-468b-98aa-eecfe793f6ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:48.760855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62726a2-a74d-468b-98aa-eecfe793f6ff admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:48.768912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 928/1852] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:48.776391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e75d9-5780-4c83-9f6c-0dc9025920b6 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.776701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e75d9-5780-4c83-9f6c-0dc9025920b6 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.776979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e75d9-5780-4c83-9f6c-0dc9025920b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.796798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-a85e75d9-5780-4c83-9f6c-0dc9025920b6 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:48.798256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a85e75d9-5780-4c83-9f6c-0dc9025920b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:48.806208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 929/1853] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:48.810590 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e75d9-5780-4c83-9f6c-0dc9025920b6 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:48.819518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e75d9-5780-4c83-9f6c-0dc9025920b6 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:48.830773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608560d0-057d-4168-9aff-b9d556517e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:48.831445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608560d0-057d-4168-9aff-b9d556517e9d admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.831747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608560d0-057d-4168-9aff-b9d556517e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.832838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608560d0-057d-4168-9aff-b9d556517e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.832838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608560d0-057d-4168-9aff-b9d556517e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:48.833107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608560d0-057d-4168-9aff-b9d556517e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:48.834729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608560d0-057d-4168-9aff-b9d556517e9d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:48.846912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 930/1854] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:44:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:44:48.851675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608560d0-057d-4168-9aff-b9d556517e9d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:48.861788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608560d0-057d-4168-9aff-b9d556517e9d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:48.866936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee114a5-050e-4c75-8c3b-adebdb36ff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:48.867587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee114a5-050e-4c75-8c3b-adebdb36ff15 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.867872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee114a5-050e-4c75-8c3b-adebdb36ff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.868150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee114a5-050e-4c75-8c3b-adebdb36ff15 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.868893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee114a5-050e-4c75-8c3b-adebdb36ff15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:48.870825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee114a5-050e-4c75-8c3b-adebdb36ff15 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:48.941490 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 925/1855] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:48 2021] POST /identity/v3/users => generated 284 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:48.958611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62726a2-a74d-468b-98aa-eecfe793f6ff admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:48.960333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d62726a2-a74d-468b-98aa-eecfe793f6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:48.975049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62726a2-a74d-468b-98aa-eecfe793f6ff admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:48.980234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ec61a-1104-439a-9a53-c47ea6cc4b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:48.980962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ec61a-1104-439a-9a53-c47ea6cc4b75 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.981273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ec61a-1104-439a-9a53-c47ea6cc4b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.981552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ec61a-1104-439a-9a53-c47ea6cc4b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.982281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ec61a-1104-439a-9a53-c47ea6cc4b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:48.983913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ec61a-1104-439a-9a53-c47ea6cc4b75 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:48.994224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 926/1856] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:49.006004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ec61a-1104-439a-9a53-c47ea6cc4b75 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:49.016619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ec61a-1104-439a-9a53-c47ea6cc4b75 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:49.021403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb7b33-635f-450a-82c6-c136b8cbfffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:49.022046 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7b33-635f-450a-82c6-c136b8cbfffb admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.022335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7b33-635f-450a-82c6-c136b8cbfffb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.022613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7b33-635f-450a-82c6-c136b8cbfffb admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.023364 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb7b33-635f-450a-82c6-c136b8cbfffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:49.024983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb7b33-635f-450a-82c6-c136b8cbfffb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:49.037429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 927/1857] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:49.041510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb7b33-635f-450a-82c6-c136b8cbfffb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:49.042142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 931/1858] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:48 2021] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:49.046025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee114a5-050e-4c75-8c3b-adebdb36ff15 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:49.054510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb7b33-635f-450a-82c6-c136b8cbfffb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:49.120776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee114a5-050e-4c75-8c3b-adebdb36ff15 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:49.125966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34619-11f3-449e-a316-4c761d8d36a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:49.126542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22e4b-650e-4132-b880-4fc07fe3d5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:49.126784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22e4b-650e-4132-b880-4fc07fe3d5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.126881 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34619-11f3-449e-a316-4c761d8d36a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.127035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22e4b-650e-4132-b880-4fc07fe3d5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.127127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34619-11f3-449e-a316-4c761d8d36a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.127322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22e4b-650e-4132-b880-4fc07fe3d5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.127417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34619-11f3-449e-a316-4c761d8d36a4 admin admin] PATH_INFO: `/v3/projects/203cf03149db4f36a323c8270f0c0c18/users/a803d14062204f92909edfeaa6f798eb/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.128033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22e4b-650e-4132-b880-4fc07fe3d5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:49.130058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22e4b-650e-4132-b880-4fc07fe3d5d9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:49.144439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34619-11f3-449e-a316-4c761d8d36a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203cf03149db4f36a323c8270f0c0c18, user_id=a803d14062204f92909edfeaa6f798eb, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:49.147173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34619-11f3-449e-a316-4c761d8d36a4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:49.231997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 932/1859] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:49 2021] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:49.237622 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22e4b-650e-4132-b880-4fc07fe3d5d9 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:49.250200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22e4b-650e-4132-b880-4fc07fe3d5d9 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:49.255591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d7932-5d38-4c22-83a9-5d3b599bbdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:49.256273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d7932-5d38-4c22-83a9-5d3b599bbdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.256597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d7932-5d38-4c22-83a9-5d3b599bbdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.256897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d7932-5d38-4c22-83a9-5d3b599bbdc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.257629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d7932-5d38-4c22-83a9-5d3b599bbdc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:49.259429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d7932-5d38-4c22-83a9-5d3b599bbdc5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:49.271048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 933/1860] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:49 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:49.275261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d7932-5d38-4c22-83a9-5d3b599bbdc5 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:49.285184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d7932-5d38-4c22-83a9-5d3b599bbdc5 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:49.292523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03910e3-64e3-4c47-89b5-2f5eabce878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:49.292523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03910e3-64e3-4c47-89b5-2f5eabce878a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.292523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03910e3-64e3-4c47-89b5-2f5eabce878a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.292523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03910e3-64e3-4c47-89b5-2f5eabce878a admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.293032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03910e3-64e3-4c47-89b5-2f5eabce878a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:49.293432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03910e3-64e3-4c47-89b5-2f5eabce878a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:49.304268 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 934/1861] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:49.308379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03910e3-64e3-4c47-89b5-2f5eabce878a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:49.318912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03910e3-64e3-4c47-89b5-2f5eabce878a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:49.324642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15778a-5054-4995-9e87-de7e29850602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:49.325563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15778a-5054-4995-9e87-de7e29850602 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.325852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15778a-5054-4995-9e87-de7e29850602 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.326134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15778a-5054-4995-9e87-de7e29850602 admin admin] PATH_INFO: `/v3/projects/67f7ec601ec14b269dbc3d1847238057/users/c580abebc291476ea787ba8a16d81f84/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.334309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 928/1862] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:49 2021] PUT /identity/v3/projects/203cf03149db4f36a323c8270f0c0c18/users/a803d14062204f92909edfeaa6f798eb/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:49.335951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9bbce-c74b-457b-91ea-ed85d52de840 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.336248 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9bbce-c74b-457b-91ea-ed85d52de840 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.336544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9bbce-c74b-457b-91ea-ed85d52de840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.343704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15778a-5054-4995-9e87-de7e29850602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f7ec601ec14b269dbc3d1847238057, user_id=c580abebc291476ea787ba8a16d81f84, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:49.346802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15778a-5054-4995-9e87-de7e29850602 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:49.367901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-3fb9bbce-c74b-457b-91ea-ed85d52de840 None None] MFA Rules not processed for user `a803d14062204f92909edfeaa6f798eb`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:49.369253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-3fb9bbce-c74b-457b-91ea-ed85d52de840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:49.440049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 929/1863] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:49 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:49.444656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9bbce-c74b-457b-91ea-ed85d52de840 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:49.467023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 935/1864] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:49 2021] PUT /identity/v3/projects/67f7ec601ec14b269dbc3d1847238057/users/c580abebc291476ea787ba8a16d81f84/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:49.483614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774109e-e230-4cc2-a5df-4a8657235a9c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.483954 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774109e-e230-4cc2-a5df-4a8657235a9c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.484462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774109e-e230-4cc2-a5df-4a8657235a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.514218 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-5774109e-e230-4cc2-a5df-4a8657235a9c None None] MFA Rules not processed for user `c580abebc291476ea787ba8a16d81f84`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:49.516336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5774109e-e230-4cc2-a5df-4a8657235a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:49.562094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9bbce-c74b-457b-91ea-ed85d52de840 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:49.599316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 936/1865] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:49 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:49.692162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774109e-e230-4cc2-a5df-4a8657235a9c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:49.693722 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5774109e-e230-4cc2-a5df-4a8657235a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:49.794512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774109e-e230-4cc2-a5df-4a8657235a9c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:49.806784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfddea-f7ed-40d6-b857-c726352cdbbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:49.807447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfddea-f7ed-40d6-b857-c726352cdbbe service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.811262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfddea-f7ed-40d6-b857-c726352cdbbe service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.812675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfddea-f7ed-40d6-b857-c726352cdbbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.822213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfddea-f7ed-40d6-b857-c726352cdbbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:49.823649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfddea-f7ed-40d6-b857-c726352cdbbe service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:49.845033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 937/1866] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:49 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:49.863401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6563f1-315a-4ca2-bb09-a681404eb6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:49.864386 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6563f1-315a-4ca2-bb09-a681404eb6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.864879 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6563f1-315a-4ca2-bb09-a681404eb6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.865387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6563f1-315a-4ca2-bb09-a681404eb6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.866323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6563f1-315a-4ca2-bb09-a681404eb6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:49.869185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6563f1-315a-4ca2-bb09-a681404eb6c4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:50.054952 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 930/1867] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:44:49 2021] POST /identity/v3/projects => generated 367 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:50.058921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfddea-f7ed-40d6-b857-c726352cdbbe service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:50.069869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfddea-f7ed-40d6-b857-c726352cdbbe service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:50.128543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb868c-67f4-4a82-ac04-d69e55e2e865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:50.129217 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb868c-67f4-4a82-ac04-d69e55e2e865 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:50.129504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb868c-67f4-4a82-ac04-d69e55e2e865 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:50.129788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb868c-67f4-4a82-ac04-d69e55e2e865 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:50.130509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb868c-67f4-4a82-ac04-d69e55e2e865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:50.132495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb868c-67f4-4a82-ac04-d69e55e2e865 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:50.435859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 938/1868] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:44:50 2021] POST /identity/v3/users => generated 290 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:50.441795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6563f1-315a-4ca2-bb09-a681404eb6c4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:50.457524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6563f1-315a-4ca2-bb09-a681404eb6c4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:50.466938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205f45-5c43-4fbf-af26-aa81f1237442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:50.467739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205f45-5c43-4fbf-af26-aa81f1237442 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:50.468097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205f45-5c43-4fbf-af26-aa81f1237442 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:50.468484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205f45-5c43-4fbf-af26-aa81f1237442 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:50.469423 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7205f45-5c43-4fbf-af26-aa81f1237442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:50.471325 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7205f45-5c43-4fbf-af26-aa81f1237442 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:50.493113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 931/1869] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:50 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:50.497902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb868c-67f4-4a82-ac04-d69e55e2e865 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:50.514305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb868c-67f4-4a82-ac04-d69e55e2e865 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:50.519667 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca34427-0abe-468f-914b-ac36b18a7a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:50.520609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca34427-0abe-468f-914b-ac36b18a7a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:50.520898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca34427-0abe-468f-914b-ac36b18a7a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:50.521225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca34427-0abe-468f-914b-ac36b18a7a12 admin admin] PATH_INFO: `/v3/projects/0ec42d4baddf4d19a825f626fe6a2fb1/users/ae74fbda8bad4327ab3b24dea54beda5/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:50.539282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca34427-0abe-468f-914b-ac36b18a7a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec42d4baddf4d19a825f626fe6a2fb1, user_id=ae74fbda8bad4327ab3b24dea54beda5, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:50.542250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca34427-0abe-468f-914b-ac36b18a7a12 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:50.702439 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 939/1870] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:50 2021] PUT /identity/v3/projects/0ec42d4baddf4d19a825f626fe6a2fb1/users/ae74fbda8bad4327ab3b24dea54beda5/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:50.706337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205f45-5c43-4fbf-af26-aa81f1237442 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:50.717349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205f45-5c43-4fbf-af26-aa81f1237442 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:50.780925 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea3b05-354e-4fd0-9904-417957712457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:50.781627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea3b05-354e-4fd0-9904-417957712457 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:50.781910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea3b05-354e-4fd0-9904-417957712457 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:50.782202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea3b05-354e-4fd0-9904-417957712457 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:50.782924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea3b05-354e-4fd0-9904-417957712457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:50.784554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea3b05-354e-4fd0-9904-417957712457 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:50.795586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 932/1871] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:44:50 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:50.801371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca34427-0abe-468f-914b-ac36b18a7a12 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:50.812304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca34427-0abe-468f-914b-ac36b18a7a12 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:50.817591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a9d1-383b-46fb-8272-5a5f0ccc00ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:50.818479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a9d1-383b-46fb-8272-5a5f0ccc00ff admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:50.818754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a9d1-383b-46fb-8272-5a5f0ccc00ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:50.819063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a9d1-383b-46fb-8272-5a5f0ccc00ff admin admin] PATH_INFO: `/v3/projects/0ec42d4baddf4d19a825f626fe6a2fb1/users/ae74fbda8bad4327ab3b24dea54beda5/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:50.821144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a9d1-383b-46fb-8272-5a5f0ccc00ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec42d4baddf4d19a825f626fe6a2fb1, user_id=ae74fbda8bad4327ab3b24dea54beda5, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:50.823967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a9d1-383b-46fb-8272-5a5f0ccc00ff admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:50.835389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 940/1872] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:44:50 2021] PUT /identity/v3/projects/0ec42d4baddf4d19a825f626fe6a2fb1/users/ae74fbda8bad4327ab3b24dea54beda5/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:50.850177 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2441c54-f315-47bb-ae9a-3388ec8f8c25 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:50.850177 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2441c54-f315-47bb-ae9a-3388ec8f8c25 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:50.850380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2441c54-f315-47bb-ae9a-3388ec8f8c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:50.881319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e2441c54-f315-47bb-ae9a-3388ec8f8c25 None None] MFA Rules not processed for user `ae74fbda8bad4327ab3b24dea54beda5`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:50.883691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e2441c54-f315-47bb-ae9a-3388ec8f8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:50.952506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 933/1873] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:44:50 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:51.678849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a9d1-383b-46fb-8272-5a5f0ccc00ff admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:51.686966 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0637a9d1-383b-46fb-8272-5a5f0ccc00ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:51.766832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a9d1-383b-46fb-8272-5a5f0ccc00ff admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:51.770826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f1bf2-c17e-4264-88a1-0368a928efbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:51.771480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f1bf2-c17e-4264-88a1-0368a928efbd service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:51.771763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f1bf2-c17e-4264-88a1-0368a928efbd service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:51.772029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f1bf2-c17e-4264-88a1-0368a928efbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:51.783215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f1bf2-c17e-4264-88a1-0368a928efbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:51.784757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f1bf2-c17e-4264-88a1-0368a928efbd service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:51.798542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 941/1874] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:51 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:52.921414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2441c54-f315-47bb-ae9a-3388ec8f8c25 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:52.940801 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2441c54-f315-47bb-ae9a-3388ec8f8c25 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:52.969411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd90f62-e17e-44f8-b8ca-ef41c630b060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:52.971312 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90f62-e17e-44f8-b8ca-ef41c630b060 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:52.971892 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90f62-e17e-44f8-b8ca-ef41c630b060 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:52.972297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90f62-e17e-44f8-b8ca-ef41c630b060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:53.101609 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd90f62-e17e-44f8-b8ca-ef41c630b060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:53.101609 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd90f62-e17e-44f8-b8ca-ef41c630b060 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:53.135930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 934/1875] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:44:52 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:02.523556 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f1bf2-c17e-4264-88a1-0368a928efbd service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:02.525102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8f2f1bf2-c17e-4264-88a1-0368a928efbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:02.599562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f1bf2-c17e-4264-88a1-0368a928efbd service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:02.604961 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:02.605832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:02.607285 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:02.607285 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] PATH_INFO: `/v3/users/3ccf3680c2ae4e24a044adb3a69ada77` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:02.608150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ccf3680c2ae4e24a044adb3a69ada77)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:02.610149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:02.759036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ccf3680c2ae4e24a044adb3a69ada77'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:02.759701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ccf3680c2ae4e24a044adb3a69ada77'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:02.760317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ccf3680c2ae4e24a044adb3a69ada77'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:02.773895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ccf3680c2ae4e24a044adb3a69ada77'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:02.877506 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ccf3680c2ae4e24a044adb3a69ada77'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:02.889686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 942/1876] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:02 2021] DELETE /identity/v3/users/3ccf3680c2ae4e24a044adb3a69ada77 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:02.894431 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41640-0185-465b-a051-81d5311d7ecf None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:02.894882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41640-0185-465b-a051-81d5311d7ecf None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:02.894990 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41640-0185-465b-a051-81d5311d7ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:02.912713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-29d41640-0185-465b-a051-81d5311d7ecf None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:02.915054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-29d41640-0185-465b-a051-81d5311d7ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:02.986364 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 935/1877] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:02.996227 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:03.001539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:03.062661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509887c6-4406-4d9d-bfb2-dd391d5b219a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:03.066484 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76784c9-fac2-436e-964e-dfaeb636270b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:03.067135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76784c9-fac2-436e-964e-dfaeb636270b service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:03.067418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76784c9-fac2-436e-964e-dfaeb636270b service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:03.067693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76784c9-fac2-436e-964e-dfaeb636270b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:03.078897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76784c9-fac2-436e-964e-dfaeb636270b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:03.080437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76784c9-fac2-436e-964e-dfaeb636270b service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:03.090966 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 943/1878] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:03.585605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d41640-0185-465b-a051-81d5311d7ecf None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:03.587121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-29d41640-0185-465b-a051-81d5311d7ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:03.599963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d41640-0185-465b-a051-81d5311d7ecf None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:03.611731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:03.612826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:03.612932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:03.613209 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] PATH_INFO: `/v3/projects/23e701bc18614219a453416ea7dd8fc6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:03.614598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e701bc18614219a453416ea7dd8fc6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:03.616878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:03.789176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e701bc18614219a453416ea7dd8fc6', 'request_id': 'req-4aadc8f7-1770-4a23-9579-2c39aafd8714'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:03.795449 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e701bc18614219a453416ea7dd8fc6', 'request_id': 'req-4aadc8f7-1770-4a23-9579-2c39aafd8714'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:03.801127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e701bc18614219a453416ea7dd8fc6', 'request_id': 'req-4aadc8f7-1770-4a23-9579-2c39aafd8714'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:03.905841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] The token cache is being invalidate because project 23e701bc18614219a453416ea7dd8fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:03.906476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:03.907391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:03.909000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 936/1879] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:03 2021] DELETE /identity/v3/projects/23e701bc18614219a453416ea7dd8fc6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:03.913261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76784c9-fac2-436e-964e-dfaeb636270b service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:03.923547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76784c9-fac2-436e-964e-dfaeb636270b service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:03.982570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:03.984889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:03.984889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:03.984889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] PATH_INFO: `/v3/users/ec28195226bd4e459f039082c441c6d8` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:03.985315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec28195226bd4e459f039082c441c6d8)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:03.987173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:04.202262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec28195226bd4e459f039082c441c6d8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:04.202985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec28195226bd4e459f039082c441c6d8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:04.203619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec28195226bd4e459f039082c441c6d8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:04.217853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec28195226bd4e459f039082c441c6d8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:04.331424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-18cc5cfa-1cf0-4fd4-bed6-241a9d977aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec28195226bd4e459f039082c441c6d8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:04.345650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 944/1880] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:03 2021] DELETE /identity/v3/users/ec28195226bd4e459f039082c441c6d8 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:04.842971 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:04.844826 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:04.862463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadc8f7-1770-4a23-9579-2c39aafd8714 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:04.920186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:04.921069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:04.921381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:04.921659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] PATH_INFO: `/v3/projects/2abc46e8b57f4ef48546d8612b3bb7f5` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:04.922824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abc46e8b57f4ef48546d8612b3bb7f5)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:04.924748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.051380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abc46e8b57f4ef48546d8612b3bb7f5', 'request_id': 'req-0f6a9297-1c48-42a6-bcf9-26590159b30c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:05.057461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abc46e8b57f4ef48546d8612b3bb7f5', 'request_id': 'req-0f6a9297-1c48-42a6-bcf9-26590159b30c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:05.062857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abc46e8b57f4ef48546d8612b3bb7f5', 'request_id': 'req-0f6a9297-1c48-42a6-bcf9-26590159b30c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:05.130080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] The token cache is being invalidate because project 2abc46e8b57f4ef48546d8612b3bb7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:05.130301 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:05.130951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0f6a9297-1c48-42a6-bcf9-26590159b30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:05.132598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 937/1881] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:04 2021] DELETE /identity/v3/projects/2abc46e8b57f4ef48546d8612b3bb7f5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:05.138889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce2fb7-f918-48a6-b2ea-d62845f957ae None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.139441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce2fb7-f918-48a6-b2ea-d62845f957ae None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.139441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce2fb7-f918-48a6-b2ea-d62845f957ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.158155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b6ce2fb7-f918-48a6-b2ea-d62845f957ae None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:05.159374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b6ce2fb7-f918-48a6-b2ea-d62845f957ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:05.219642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 945/1882] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:05.228809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2819244-b06b-426e-b3fe-4e5cba9ad84c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.229093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2819244-b06b-426e-b3fe-4e5cba9ad84c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.229366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2819244-b06b-426e-b3fe-4e5cba9ad84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.253769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f2819244-b06b-426e-b3fe-4e5cba9ad84c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:05.253769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f2819244-b06b-426e-b3fe-4e5cba9ad84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:05.260941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 938/1883] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:05.266152 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce2fb7-f918-48a6-b2ea-d62845f957ae None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:05.276879 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce2fb7-f918-48a6-b2ea-d62845f957ae None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:05.289872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb82ea-8be3-4b76-968c-a24b8adda488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:05.289872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb82ea-8be3-4b76-968c-a24b8adda488 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.289872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb82ea-8be3-4b76-968c-a24b8adda488 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.289872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb82ea-8be3-4b76-968c-a24b8adda488 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.290322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb82ea-8be3-4b76-968c-a24b8adda488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:05.290322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb82ea-8be3-4b76-968c-a24b8adda488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:05.290322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb82ea-8be3-4b76-968c-a24b8adda488 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.310950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 946/1884] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:05.317528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2819244-b06b-426e-b3fe-4e5cba9ad84c None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:05.327393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb82ea-8be3-4b76-968c-a24b8adda488 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:05.328451 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2819244-b06b-426e-b3fe-4e5cba9ad84c None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:05.329325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-43bb82ea-8be3-4b76-968c-a24b8adda488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:05.333261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e42bbb-b1fc-460d-9260-a3e29e5fc929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:05.333927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e42bbb-b1fc-460d-9260-a3e29e5fc929 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.334261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e42bbb-b1fc-460d-9260-a3e29e5fc929 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.334540 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e42bbb-b1fc-460d-9260-a3e29e5fc929 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.335316 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e42bbb-b1fc-460d-9260-a3e29e5fc929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:05.337317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e42bbb-b1fc-460d-9260-a3e29e5fc929 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.342722 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb82ea-8be3-4b76-968c-a24b8adda488 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:05.347428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:05.348321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.348683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.354005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] PATH_INFO: `/v3/users/c580abebc291476ea787ba8a16d81f84` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.354005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c580abebc291476ea787ba8a16d81f84)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:05.354005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.459133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 939/1885] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:05 2021] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:05.463208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e42bbb-b1fc-460d-9260-a3e29e5fc929 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:05.524257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e42bbb-b1fc-460d-9260-a3e29e5fc929 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:05.529267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcfa99-6266-4eeb-9593-6820c76369a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:05.529939 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcfa99-6266-4eeb-9593-6820c76369a0 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.530217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcfa99-6266-4eeb-9593-6820c76369a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.530486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcfa99-6266-4eeb-9593-6820c76369a0 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.531162 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcfa99-6266-4eeb-9593-6820c76369a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:05.533097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcfa99-6266-4eeb-9593-6820c76369a0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.576675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c580abebc291476ea787ba8a16d81f84'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:05.577371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c580abebc291476ea787ba8a16d81f84'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:05.577986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c580abebc291476ea787ba8a16d81f84'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:05.589762 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c580abebc291476ea787ba8a16d81f84'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:05.640715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 940/1886] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:05 2021] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:05.644923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcfa99-6266-4eeb-9593-6820c76369a0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:05.646522 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-44dcfa99-6266-4eeb-9593-6820c76369a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:05.658443 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcfa99-6266-4eeb-9593-6820c76369a0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:05.662552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-31b9fc05-763f-4437-84c9-f6fe38493720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c580abebc291476ea787ba8a16d81f84'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:05.667624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48080a4c-3006-4fbe-96f2-c609835b6a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:05.667624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48080a4c-3006-4fbe-96f2-c609835b6a39 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.667624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48080a4c-3006-4fbe-96f2-c609835b6a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.667624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48080a4c-3006-4fbe-96f2-c609835b6a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.667992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48080a4c-3006-4fbe-96f2-c609835b6a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:05.667992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48080a4c-3006-4fbe-96f2-c609835b6a39 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.675662 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 947/1887] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:05 2021] DELETE /identity/v3/users/c580abebc291476ea787ba8a16d81f84 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:05.680103 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45154326-1928-4364-b245-763ef4ea1f5f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.680406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45154326-1928-4364-b245-763ef4ea1f5f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.680702 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45154326-1928-4364-b245-763ef4ea1f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.683492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 941/1888] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:05 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:05.687915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48080a4c-3006-4fbe-96f2-c609835b6a39 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:05.699103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48080a4c-3006-4fbe-96f2-c609835b6a39 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:05.701390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-45154326-1928-4364-b245-763ef4ea1f5f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:05.702674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-45154326-1928-4364-b245-763ef4ea1f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:05.756581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47ac4a-e136-4281-a143-cb16d3015552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:05.757256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47ac4a-e136-4281-a143-cb16d3015552 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.757543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47ac4a-e136-4281-a143-cb16d3015552 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.757837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47ac4a-e136-4281-a143-cb16d3015552 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.758558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47ac4a-e136-4281-a143-cb16d3015552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:05.760140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47ac4a-e136-4281-a143-cb16d3015552 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.769871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 948/1889] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:05.775051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 942/1890] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:05 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:05.782271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45154326-1928-4364-b245-763ef4ea1f5f None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:05.782357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47ac4a-e136-4281-a143-cb16d3015552 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:05.782357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-bc47ac4a-e136-4281-a143-cb16d3015552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:05.786789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45154326-1928-4364-b245-763ef4ea1f5f None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:05.791936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13624ff4-542b-4ed2-95a5-417478677920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:05.792980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13624ff4-542b-4ed2-95a5-417478677920 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.793347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13624ff4-542b-4ed2-95a5-417478677920 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.793850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13624ff4-542b-4ed2-95a5-417478677920 admin admin] PATH_INFO: `/v3/projects/0ffe9aa450ba4ac8b4645f39d8358f66/users/77d8bfbfa1d7456b80691a613a357e42/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.814482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13624ff4-542b-4ed2-95a5-417478677920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ffe9aa450ba4ac8b4645f39d8358f66, user_id=77d8bfbfa1d7456b80691a613a357e42, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:05.817445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13624ff4-542b-4ed2-95a5-417478677920 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.844573 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47ac4a-e136-4281-a143-cb16d3015552 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:05.848247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd55ca-13f8-4e9e-b19c-2e530395a2bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:05.848927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd55ca-13f8-4e9e-b19c-2e530395a2bf service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.849209 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd55ca-13f8-4e9e-b19c-2e530395a2bf service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.849548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd55ca-13f8-4e9e-b19c-2e530395a2bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.859495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd55ca-13f8-4e9e-b19c-2e530395a2bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:05.863446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd55ca-13f8-4e9e-b19c-2e530395a2bf service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.873045 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 943/1891] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:05.929210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 949/1892] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:05 2021] PUT /identity/v3/projects/0ffe9aa450ba4ac8b4645f39d8358f66/users/77d8bfbfa1d7456b80691a613a357e42/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:05.930524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8231d-358a-4bd2-bc17-9e989a0da13e None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.930967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8231d-358a-4bd2-bc17-9e989a0da13e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.931084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8231d-358a-4bd2-bc17-9e989a0da13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.961457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-46c8231d-358a-4bd2-bc17-9e989a0da13e None None] MFA Rules not processed for user `77d8bfbfa1d7456b80691a613a357e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:05.962930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-46c8231d-358a-4bd2-bc17-9e989a0da13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:06.035449 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 944/1893] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:05 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:06.039968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13624ff4-542b-4ed2-95a5-417478677920 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.102835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13624ff4-542b-4ed2-95a5-417478677920 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.108455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621406-1bf5-4adc-a08e-9a11a21d0f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.109116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621406-1bf5-4adc-a08e-9a11a21d0f9f admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.109398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621406-1bf5-4adc-a08e-9a11a21d0f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.109677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621406-1bf5-4adc-a08e-9a11a21d0f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.110473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12621406-1bf5-4adc-a08e-9a11a21d0f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.112524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12621406-1bf5-4adc-a08e-9a11a21d0f9f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.225583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8231d-358a-4bd2-bc17-9e989a0da13e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.227065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-46c8231d-358a-4bd2-bc17-9e989a0da13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:06.241477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8231d-358a-4bd2-bc17-9e989a0da13e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.245682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 950/1894] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:06 2021] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:06.249395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621406-1bf5-4adc-a08e-9a11a21d0f9f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.249868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.250886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.251241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.251521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] PATH_INFO: `/v3/users/a803d14062204f92909edfeaa6f798eb` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.252912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a803d14062204f92909edfeaa6f798eb)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.254869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.323158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621406-1bf5-4adc-a08e-9a11a21d0f9f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.330185 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44366f96-3ae8-4e21-983c-e2cb82f5fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.330869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44366f96-3ae8-4e21-983c-e2cb82f5fb54 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.331159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44366f96-3ae8-4e21-983c-e2cb82f5fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.331459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44366f96-3ae8-4e21-983c-e2cb82f5fb54 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.332225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44366f96-3ae8-4e21-983c-e2cb82f5fb54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.334093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44366f96-3ae8-4e21-983c-e2cb82f5fb54 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.423593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 951/1895] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:06 2021] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:06.423593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44366f96-3ae8-4e21-983c-e2cb82f5fb54 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.423593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-44366f96-3ae8-4e21-983c-e2cb82f5fb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:06.432112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a803d14062204f92909edfeaa6f798eb'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.437414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44366f96-3ae8-4e21-983c-e2cb82f5fb54 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.443166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.444046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.444333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.444650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] PATH_INFO: `/v3/projects/67f7ec601ec14b269dbc3d1847238057` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.445850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f7ec601ec14b269dbc3d1847238057)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.446392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a803d14062204f92909edfeaa6f798eb'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.447142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a803d14062204f92909edfeaa6f798eb'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.447770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.454123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a803d14062204f92909edfeaa6f798eb'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.513841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a803d14062204f92909edfeaa6f798eb'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.520509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 945/1896] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:06 2021] DELETE /identity/v3/users/a803d14062204f92909edfeaa6f798eb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:06.521365 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.522789 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:06.549922 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f7ec601ec14b269dbc3d1847238057', 'request_id': 'req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.594366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10daaf8b-7d58-4f2a-9e3c-c7f761a426ab admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.625796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f7ec601ec14b269dbc3d1847238057', 'request_id': 'req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.631776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f7ec601ec14b269dbc3d1847238057', 'request_id': 'req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.644886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] The token cache is being invalidate because project 67f7ec601ec14b269dbc3d1847238057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:06.645177 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.645848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-1aaa2002-f4ef-40e7-9555-b4e9f4aed7ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.647428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 952/1897] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:06 2021] DELETE /identity/v3/projects/67f7ec601ec14b269dbc3d1847238057 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:06.648890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b204d9-00c5-491c-ad3c-be5c0463dbbd None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.649179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b204d9-00c5-491c-ad3c-be5c0463dbbd None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.649456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b204d9-00c5-491c-ad3c-be5c0463dbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.651885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a954a2b-69da-47e9-a446-90eaf10a5108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.652799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954a2b-69da-47e9-a446-90eaf10a5108 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.653485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954a2b-69da-47e9-a446-90eaf10a5108 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.653764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954a2b-69da-47e9-a446-90eaf10a5108 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.654493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a954a2b-69da-47e9-a446-90eaf10a5108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.660030 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a954a2b-69da-47e9-a446-90eaf10a5108 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.666618 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 946/1898] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:06 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:06.667794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-a6b204d9-00c5-491c-ad3c-be5c0463dbbd None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:06.667949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3ef0a-8f01-433d-a0fd-c39a7eec1109 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.668189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3ef0a-8f01-433d-a0fd-c39a7eec1109 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.668566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3ef0a-8f01-433d-a0fd-c39a7eec1109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.669259 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a6b204d9-00c5-491c-ad3c-be5c0463dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:06.677884 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 953/1899] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:06.678572 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b204d9-00c5-491c-ad3c-be5c0463dbbd None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.679910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a6b204d9-00c5-491c-ad3c-be5c0463dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:06.691587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b204d9-00c5-491c-ad3c-be5c0463dbbd None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.696166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-66a3ef0a-8f01-433d-a0fd-c39a7eec1109 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:06.697739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-66a3ef0a-8f01-433d-a0fd-c39a7eec1109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:06.698658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181b093-a8be-4ca5-8b7e-0de3acc43065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.700158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181b093-a8be-4ca5-8b7e-0de3acc43065 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.700472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181b093-a8be-4ca5-8b7e-0de3acc43065 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.700830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181b093-a8be-4ca5-8b7e-0de3acc43065 admin admin] PATH_INFO: `/v3/projects/312b35cfcca24f8cb416f0e9396fb453/users/082ae6bf1b3b4da99e0bfce9969eb31f/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.706916 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 947/1900] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:06.712683 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3ef0a-8f01-433d-a0fd-c39a7eec1109 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.713758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-66a3ef0a-8f01-433d-a0fd-c39a7eec1109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:06.717016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181b093-a8be-4ca5-8b7e-0de3acc43065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312b35cfcca24f8cb416f0e9396fb453, user_id=082ae6bf1b3b4da99e0bfce9969eb31f, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.719712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181b093-a8be-4ca5-8b7e-0de3acc43065 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.768409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3ef0a-8f01-433d-a0fd-c39a7eec1109 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.772081 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1e135-680c-45f5-baad-0d996a01e096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.772706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1e135-680c-45f5-baad-0d996a01e096 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.772987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1e135-680c-45f5-baad-0d996a01e096 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.773259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1e135-680c-45f5-baad-0d996a01e096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.783419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1e135-680c-45f5-baad-0d996a01e096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.784955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1e135-680c-45f5-baad-0d996a01e096 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.794093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 954/1901] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:06 2021] PUT /identity/v3/projects/312b35cfcca24f8cb416f0e9396fb453/users/082ae6bf1b3b4da99e0bfce9969eb31f/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:06.795628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e815c-596f-47f8-9169-964a16e365eb None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.795998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e815c-596f-47f8-9169-964a16e365eb None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.796397 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e815c-596f-47f8-9169-964a16e365eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.796896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 948/1902] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:06.798161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1e135-680c-45f5-baad-0d996a01e096 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.816333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1e135-680c-45f5-baad-0d996a01e096 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.817056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-617e815c-596f-47f8-9169-964a16e365eb None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:06.818411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-617e815c-596f-47f8-9169-964a16e365eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:06.884566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7333ea2-94aa-4011-9b0c-db5fbf90317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.885256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7333ea2-94aa-4011-9b0c-db5fbf90317b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.885545 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7333ea2-94aa-4011-9b0c-db5fbf90317b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.885832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7333ea2-94aa-4011-9b0c-db5fbf90317b admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.886602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7333ea2-94aa-4011-9b0c-db5fbf90317b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.888792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7333ea2-94aa-4011-9b0c-db5fbf90317b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.899687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 955/1903] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:06.900656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 949/1904] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:06 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:06.904416 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e815c-596f-47f8-9169-964a16e365eb None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.906191 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7333ea2-94aa-4011-9b0c-db5fbf90317b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.915251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e815c-596f-47f8-9169-964a16e365eb None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.918439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7333ea2-94aa-4011-9b0c-db5fbf90317b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.921708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680426ba-1a21-43a1-8d65-3f57f66d03f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.922791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680426ba-1a21-43a1-8d65-3f57f66d03f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.923008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680426ba-1a21-43a1-8d65-3f57f66d03f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.923266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e6468-0c94-4013-a083-48842af0a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.923383 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680426ba-1a21-43a1-8d65-3f57f66d03f8 admin admin] PATH_INFO: `/v3/projects/312b35cfcca24f8cb416f0e9396fb453/users/082ae6bf1b3b4da99e0bfce9969eb31f/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.923945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e6468-0c94-4013-a083-48842af0a86d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.924274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e6468-0c94-4013-a083-48842af0a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.924512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e6468-0c94-4013-a083-48842af0a86d admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.925230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e6468-0c94-4013-a083-48842af0a86d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:06.925336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680426ba-1a21-43a1-8d65-3f57f66d03f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312b35cfcca24f8cb416f0e9396fb453, user_id=082ae6bf1b3b4da99e0bfce9969eb31f, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.925530 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e6468-0c94-4013-a083-48842af0a86d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.927425 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e6468-0c94-4013-a083-48842af0a86d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.928107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680426ba-1a21-43a1-8d65-3f57f66d03f8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.939825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 956/1905] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:06 2021] PUT /identity/v3/projects/312b35cfcca24f8cb416f0e9396fb453/users/082ae6bf1b3b4da99e0bfce9969eb31f/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:06.940975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 950/1906] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:06.953773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680426ba-1a21-43a1-8d65-3f57f66d03f8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.958064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0e0f-d536-4f1c-8ad9-e1a5a1df2463 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.958356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0e0f-d536-4f1c-8ad9-e1a5a1df2463 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.958633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0e0f-d536-4f1c-8ad9-e1a5a1df2463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.986608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-077b0e0f-d536-4f1c-8ad9-e1a5a1df2463 None None] MFA Rules not processed for user `082ae6bf1b3b4da99e0bfce9969eb31f`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:06.987836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-077b0e0f-d536-4f1c-8ad9-e1a5a1df2463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:07.021715 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680426ba-1a21-43a1-8d65-3f57f66d03f8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:07.026678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a064a-25a4-4d1a-9ed1-f2e54901e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:07.029037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a064a-25a4-4d1a-9ed1-f2e54901e6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:07.029037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a064a-25a4-4d1a-9ed1-f2e54901e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:07.029037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a064a-25a4-4d1a-9ed1-f2e54901e6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:07.030061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a064a-25a4-4d1a-9ed1-f2e54901e6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:07.031656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a064a-25a4-4d1a-9ed1-f2e54901e6e6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:07.072330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 951/1907] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:06 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:07.083397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b0e0f-d536-4f1c-8ad9-e1a5a1df2463 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:07.085521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-077b0e0f-d536-4f1c-8ad9-e1a5a1df2463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:07.155853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b0e0f-d536-4f1c-8ad9-e1a5a1df2463 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:07.156732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 957/1908] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:06 2021] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:07.168201 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a064a-25a4-4d1a-9ed1-f2e54901e6e6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:07.232997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cb1e0-86a8-41a3-80e7-9663888d74e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:07.233671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cb1e0-86a8-41a3-80e7-9663888d74e2 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:07.234106 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cb1e0-86a8-41a3-80e7-9663888d74e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:07.234381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cb1e0-86a8-41a3-80e7-9663888d74e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:07.253611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a064a-25a4-4d1a-9ed1-f2e54901e6e6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:07.261131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc052e-45e8-42ed-a21e-84e91e54f836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:07.262862 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc052e-45e8-42ed-a21e-84e91e54f836 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:07.263453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc052e-45e8-42ed-a21e-84e91e54f836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:07.263930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc052e-45e8-42ed-a21e-84e91e54f836 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:07.264952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc052e-45e8-42ed-a21e-84e91e54f836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:07.267509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc052e-45e8-42ed-a21e-84e91e54f836 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:07.310249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cb1e0-86a8-41a3-80e7-9663888d74e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:07.311690 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cb1e0-86a8-41a3-80e7-9663888d74e2 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:07.322931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 952/1909] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:07 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:07.386050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 958/1910] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:07 2021] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:07.387723 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cb1e0-86a8-41a3-80e7-9663888d74e2 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:07.388240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc052e-45e8-42ed-a21e-84e91e54f836 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:07.389556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-cf7cb1e0-86a8-41a3-80e7-9663888d74e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:07.399269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc052e-45e8-42ed-a21e-84e91e54f836 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:07.409040 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63261-7a04-4976-885a-af4e3af4f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:07.409325 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cb1e0-86a8-41a3-80e7-9663888d74e2 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:07.410668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63261-7a04-4976-885a-af4e3af4f373 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:07.410668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63261-7a04-4976-885a-af4e3af4f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:07.410668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63261-7a04-4976-885a-af4e3af4f373 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:07.422478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:07.422478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:07.422478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:07.422478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] PATH_INFO: `/v3/projects/203cf03149db4f36a323c8270f0c0c18` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:07.423212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c63261-7a04-4976-885a-af4e3af4f373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:07.423286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=203cf03149db4f36a323c8270f0c0c18)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:07.423364 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c63261-7a04-4976-885a-af4e3af4f373 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:07.423433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:07.433686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 959/1911] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:07 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:07.435913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63261-7a04-4976-885a-af4e3af4f373 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:07.447372 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63261-7a04-4976-885a-af4e3af4f373 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:07.451909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a7d0d-aad6-4f2e-b7df-8507c82f3b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:07.452707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a7d0d-aad6-4f2e-b7df-8507c82f3b92 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:07.452992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a7d0d-aad6-4f2e-b7df-8507c82f3b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:07.453981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a7d0d-aad6-4f2e-b7df-8507c82f3b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:07.454270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a7d0d-aad6-4f2e-b7df-8507c82f3b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:07.456177 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a7d0d-aad6-4f2e-b7df-8507c82f3b92 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:07.471435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 960/1912] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:07.473024 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a7d0d-aad6-4f2e-b7df-8507c82f3b92 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:07.485615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a7d0d-aad6-4f2e-b7df-8507c82f3b92 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:07.490532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e257c-614e-4b31-9a6b-072ceeec8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:07.491424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e257c-614e-4b31-9a6b-072ceeec8d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:07.491999 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e257c-614e-4b31-9a6b-072ceeec8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:07.491999 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e257c-614e-4b31-9a6b-072ceeec8d82 admin admin] PATH_INFO: `/v3/projects/92b58305e4254a90a3ca4ad2b52756f5/users/e87c6b2f12d04a6d8929e960e6268761/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:07.508149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e257c-614e-4b31-9a6b-072ceeec8d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b58305e4254a90a3ca4ad2b52756f5, user_id=e87c6b2f12d04a6d8929e960e6268761, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:07.510883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e257c-614e-4b31-9a6b-072ceeec8d82 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:07.606655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 961/1913] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:07 2021] PUT /identity/v3/projects/92b58305e4254a90a3ca4ad2b52756f5/users/e87c6b2f12d04a6d8929e960e6268761/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:07.611845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7622-812c-4006-8a81-648bf0400816 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:07.612139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7622-812c-4006-8a81-648bf0400816 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:07.612442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7622-812c-4006-8a81-648bf0400816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:07.615239 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203cf03149db4f36a323c8270f0c0c18', 'request_id': 'req-f027bfd4-644c-485c-b0dc-8f540605a72d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:07.622880 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203cf03149db4f36a323c8270f0c0c18', 'request_id': 'req-f027bfd4-644c-485c-b0dc-8f540605a72d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:07.630195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203cf03149db4f36a323c8270f0c0c18', 'request_id': 'req-f027bfd4-644c-485c-b0dc-8f540605a72d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:07.632060 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-816d7622-812c-4006-8a81-648bf0400816 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:07.633356 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-816d7622-812c-4006-8a81-648bf0400816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:07.695529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 962/1914] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:07.705461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d7622-812c-4006-8a81-648bf0400816 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:07.706876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-816d7622-812c-4006-8a81-648bf0400816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:07.736560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] The token cache is being invalidate because project 203cf03149db4f36a323c8270f0c0c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:07.736872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:07.737757 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:07.741264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 953/1915] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:07 2021] DELETE /identity/v3/projects/203cf03149db4f36a323c8270f0c0c18 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:07.745741 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:07.747801 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:07.763587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bfd4-644c-485c-b0dc-8f540605a72d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:07.773875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:07.774795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:07.775498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:07.775786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] PATH_INFO: `/v3/users/ae74fbda8bad4327ab3b24dea54beda5` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:07.777165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae74fbda8bad4327ab3b24dea54beda5)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:07.779701 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:07.781117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d7622-812c-4006-8a81-648bf0400816 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:07.791661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258ea86-a611-4558-9835-346b34f353cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:07.791661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258ea86-a611-4558-9835-346b34f353cf service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:07.791661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258ea86-a611-4558-9835-346b34f353cf service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:07.791661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258ea86-a611-4558-9835-346b34f353cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:07.792063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7258ea86-a611-4558-9835-346b34f353cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:07.801417 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258ea86-a611-4558-9835-346b34f353cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:07.802870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258ea86-a611-4558-9835-346b34f353cf service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:07.812558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 963/1916] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:08.000789 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae74fbda8bad4327ab3b24dea54beda5'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:08.016906 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae74fbda8bad4327ab3b24dea54beda5'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:08.017655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae74fbda8bad4327ab3b24dea54beda5'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:08.026917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae74fbda8bad4327ab3b24dea54beda5'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:08.119561 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae74fbda8bad4327ab3b24dea54beda5'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:08.126385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 954/1917] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:07 2021] DELETE /identity/v3/users/ae74fbda8bad4327ab3b24dea54beda5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:08.739729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258ea86-a611-4558-9835-346b34f353cf service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:08.741286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7258ea86-a611-4558-9835-346b34f353cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:08.753268 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258ea86-a611-4558-9835-346b34f353cf service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:08.796023 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:08.797844 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:08.826154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:08.827115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:08.827403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:08.827689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] PATH_INFO: `/v3/users/77d8bfbfa1d7456b80691a613a357e42` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:08.829110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d8bfbfa1d7456b80691a613a357e42)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:08.831337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:08.885375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa246b4-bb78-44a6-baf8-2cc9524391d9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:08.890588 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:08.891462 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:08.893312 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:08.893312 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] PATH_INFO: `/v3/projects/0ec42d4baddf4d19a825f626fe6a2fb1` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:08.894205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec42d4baddf4d19a825f626fe6a2fb1)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:08.896138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:09.050194 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d8bfbfa1d7456b80691a613a357e42'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.050995 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d8bfbfa1d7456b80691a613a357e42'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.051701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d8bfbfa1d7456b80691a613a357e42'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.054613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec42d4baddf4d19a825f626fe6a2fb1', 'request_id': 'req-6b7b7389-db28-4c59-ab5c-a3a99872d4de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.064222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec42d4baddf4d19a825f626fe6a2fb1', 'request_id': 'req-6b7b7389-db28-4c59-ab5c-a3a99872d4de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.070659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec42d4baddf4d19a825f626fe6a2fb1', 'request_id': 'req-6b7b7389-db28-4c59-ab5c-a3a99872d4de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.079663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d8bfbfa1d7456b80691a613a357e42'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.161047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] The token cache is being invalidate because project 0ec42d4baddf4d19a825f626fe6a2fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:09.161843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.162664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6b7b7389-db28-4c59-ab5c-a3a99872d4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.170041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 955/1918] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:08 2021] DELETE /identity/v3/projects/0ec42d4baddf4d19a825f626fe6a2fb1 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:09.171927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6398013-242c-4daa-9e2c-82208a1d0787 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.172226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6398013-242c-4daa-9e2c-82208a1d0787 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.172692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6398013-242c-4daa-9e2c-82208a1d0787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.197399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a6398013-242c-4daa-9e2c-82208a1d0787 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:09.198959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a6398013-242c-4daa-9e2c-82208a1d0787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:09.245302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-83da6249-dece-4ab7-aee0-a807926c0f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d8bfbfa1d7456b80691a613a357e42'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.260764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 964/1919] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:08 2021] DELETE /identity/v3/users/77d8bfbfa1d7456b80691a613a357e42 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:09.265528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65994832-4a66-4ec6-8b40-0fdfbe5e179c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.265814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65994832-4a66-4ec6-8b40-0fdfbe5e179c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.266086 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65994832-4a66-4ec6-8b40-0fdfbe5e179c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.267182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 956/1920] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:09.275129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08e554-65cd-449c-93ec-b8702941d4a5 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.275416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08e554-65cd-449c-93ec-b8702941d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.275768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08e554-65cd-449c-93ec-b8702941d4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.288973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-65994832-4a66-4ec6-8b40-0fdfbe5e179c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:09.290248 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-65994832-4a66-4ec6-8b40-0fdfbe5e179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:09.296138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-0a08e554-65cd-449c-93ec-b8702941d4a5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:09.297340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0a08e554-65cd-449c-93ec-b8702941d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:09.368421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 965/1921] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:09.374513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 957/1922] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:09.379919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65994832-4a66-4ec6-8b40-0fdfbe5e179c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:09.381215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08e554-65cd-449c-93ec-b8702941d4a5 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:09.383481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0a08e554-65cd-449c-93ec-b8702941d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:09.397756 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65994832-4a66-4ec6-8b40-0fdfbe5e179c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:09.409952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d0f5d-3aa4-4c94-9932-4a967769232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:09.411781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d0f5d-3aa4-4c94-9932-4a967769232c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.412848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d0f5d-3aa4-4c94-9932-4a967769232c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.413581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d0f5d-3aa4-4c94-9932-4a967769232c admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.415574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d0f5d-3aa4-4c94-9932-4a967769232c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:09.416864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d0f5d-3aa4-4c94-9932-4a967769232c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:09.420384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d0f5d-3aa4-4c94-9932-4a967769232c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:09.441131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 966/1923] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:09.446808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d0f5d-3aa4-4c94-9932-4a967769232c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:09.488850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d0f5d-3aa4-4c94-9932-4a967769232c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:09.497981 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08e554-65cd-449c-93ec-b8702941d4a5 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:09.500133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b0170-6897-4433-bf4c-958dfdddd8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:09.501408 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b0170-6897-4433-bf4c-958dfdddd8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.505146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b0170-6897-4433-bf4c-958dfdddd8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.505146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b0170-6897-4433-bf4c-958dfdddd8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.505146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b0170-6897-4433-bf4c-958dfdddd8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:09.508410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbe990-1907-4488-afb6-1d2eee669caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:09.508622 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b0170-6897-4433-bf4c-958dfdddd8e4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:09.508719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbe990-1907-4488-afb6-1d2eee669caf service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.508992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbe990-1907-4488-afb6-1d2eee669caf service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.509971 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbe990-1907-4488-afb6-1d2eee669caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.540716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbe990-1907-4488-afb6-1d2eee669caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:09.544031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbe990-1907-4488-afb6-1d2eee669caf service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:09.559663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 958/1924] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:09.561138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759b019-03fb-4af7-bd64-0b0fa7fa3b69 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.561419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759b019-03fb-4af7-bd64-0b0fa7fa3b69 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.561700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759b019-03fb-4af7-bd64-0b0fa7fa3b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.601574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d759b019-03fb-4af7-bd64-0b0fa7fa3b69 None None] MFA Rules not processed for user `e87c6b2f12d04a6d8929e960e6268761`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:09.603387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d759b019-03fb-4af7-bd64-0b0fa7fa3b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:09.697252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 959/1925] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:09 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:09.731068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 967/1926] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:09 2021] POST /identity/v3/projects => generated 385 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:09.735554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759b019-03fb-4af7-bd64-0b0fa7fa3b69 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:09.746614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759b019-03fb-4af7-bd64-0b0fa7fa3b69 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:09.811163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dbf7c-9133-44a8-a276-aeb690ba7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:09.812533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dbf7c-9133-44a8-a276-aeb690ba7583 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.812533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dbf7c-9133-44a8-a276-aeb690ba7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.812533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dbf7c-9133-44a8-a276-aeb690ba7583 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.813145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dbf7c-9133-44a8-a276-aeb690ba7583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:09.819148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dbf7c-9133-44a8-a276-aeb690ba7583 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:09.919068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b0170-6897-4433-bf4c-958dfdddd8e4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:09.925310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 960/1927] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:09 2021] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:09.925988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d81b0170-6897-4433-bf4c-958dfdddd8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:09.935576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dbf7c-9133-44a8-a276-aeb690ba7583 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:09.946727 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dbf7c-9133-44a8-a276-aeb690ba7583 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:09.953985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c9023-324d-48c3-a8e1-41890282c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:09.954816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c9023-324d-48c3-a8e1-41890282c1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.955227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c9023-324d-48c3-a8e1-41890282c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.955695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c9023-324d-48c3-a8e1-41890282c1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.957910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c9023-324d-48c3-a8e1-41890282c1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:09.960561 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c9023-324d-48c3-a8e1-41890282c1e6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:09.980438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 961/1928] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:09 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:09.981688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c9023-324d-48c3-a8e1-41890282c1e6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.010679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c9023-324d-48c3-a8e1-41890282c1e6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.030680 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad5381-7faf-4708-a964-a6e93e722a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.031485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad5381-7faf-4708-a964-a6e93e722a39 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.032043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad5381-7faf-4708-a964-a6e93e722a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.032537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad5381-7faf-4708-a964-a6e93e722a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.033506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad5381-7faf-4708-a964-a6e93e722a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.035322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad5381-7faf-4708-a964-a6e93e722a39 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.035918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b0170-6897-4433-bf4c-958dfdddd8e4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.039693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d50ea-d72b-409c-aaed-5fcc7ef033a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.040341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d50ea-d72b-409c-aaed-5fcc7ef033a3 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.040828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d50ea-d72b-409c-aaed-5fcc7ef033a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.041106 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d50ea-d72b-409c-aaed-5fcc7ef033a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.046918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 962/1929] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:09 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:10.051319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad5381-7faf-4708-a964-a6e93e722a39 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.067384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad5381-7faf-4708-a964-a6e93e722a39 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.073388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f64bc-8577-4ba1-9f8a-37355dd90661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.074317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f64bc-8577-4ba1-9f8a-37355dd90661 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.075144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f64bc-8577-4ba1-9f8a-37355dd90661 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.075432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f64bc-8577-4ba1-9f8a-37355dd90661 admin admin] PATH_INFO: `/v3/projects/77f6057e8c2f494cba500ba65bba7d1a/users/9c1fd1406ad649a0b23dc7c710d6ad0c/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.092402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f64bc-8577-4ba1-9f8a-37355dd90661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f6057e8c2f494cba500ba65bba7d1a, user_id=9c1fd1406ad649a0b23dc7c710d6ad0c, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.095275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f64bc-8577-4ba1-9f8a-37355dd90661 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.124164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d50ea-d72b-409c-aaed-5fcc7ef033a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.125279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d50ea-d72b-409c-aaed-5fcc7ef033a3 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.134838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 968/1930] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:09 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:10.136193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf677db-7bc3-4a10-b6aa-629d3b14d349 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.136521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf677db-7bc3-4a10-b6aa-629d3b14d349 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.137657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf677db-7bc3-4a10-b6aa-629d3b14d349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.175207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-edf677db-7bc3-4a10-b6aa-629d3b14d349 None None] MFA Rules not processed for user `b5b99e0829e84f2bb0a58e835a1cdc47`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:10.176809 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-edf677db-7bc3-4a10-b6aa-629d3b14d349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:10.228237 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 963/1931] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:10 2021] PUT /identity/v3/projects/77f6057e8c2f494cba500ba65bba7d1a/users/9c1fd1406ad649a0b23dc7c710d6ad0c/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:10.229541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f64bc-8577-4ba1-9f8a-37355dd90661 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.232773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7b6f64bc-8577-4ba1-9f8a-37355dd90661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:10.257855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 969/1932] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:10 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:10.259200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57ae4-8ec1-47ea-8836-029c3963d6d6 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.259484 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57ae4-8ec1-47ea-8836-029c3963d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.259757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57ae4-8ec1-47ea-8836-029c3963d6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.304736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-60b57ae4-8ec1-47ea-8836-029c3963d6d6 None None] MFA Rules not processed for user `9c1fd1406ad649a0b23dc7c710d6ad0c`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:10.306224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-60b57ae4-8ec1-47ea-8836-029c3963d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:10.317581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f64bc-8577-4ba1-9f8a-37355dd90661 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.322551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.323416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.323700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.323977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] PATH_INFO: `/v3/projects/0ffe9aa450ba4ac8b4645f39d8358f66` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.325838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ffe9aa450ba4ac8b4645f39d8358f66)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.328248 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.376790 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 970/1933] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:10 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:10.381339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57ae4-8ec1-47ea-8836-029c3963d6d6 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.393203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57ae4-8ec1-47ea-8836-029c3963d6d6 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.398127 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020750a-7823-4100-a99b-1e945d200c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.398837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020750a-7823-4100-a99b-1e945d200c26 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.399129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020750a-7823-4100-a99b-1e945d200c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.399418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020750a-7823-4100-a99b-1e945d200c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.400112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020750a-7823-4100-a99b-1e945d200c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.402210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020750a-7823-4100-a99b-1e945d200c26 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.461211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ffe9aa450ba4ac8b4645f39d8358f66', 'request_id': 'req-49df5ea9-e967-4585-9105-23f955b28826'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:10.468060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ffe9aa450ba4ac8b4645f39d8358f66', 'request_id': 'req-49df5ea9-e967-4585-9105-23f955b28826'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:10.474902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ffe9aa450ba4ac8b4645f39d8358f66', 'request_id': 'req-49df5ea9-e967-4585-9105-23f955b28826'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:10.485399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 971/1934] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:10 2021] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:10.489590 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020750a-7823-4100-a99b-1e945d200c26 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.553936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020750a-7823-4100-a99b-1e945d200c26 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.559137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab5bb3-76a6-4298-999f-7efa5eff6de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.559742 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab5bb3-76a6-4298-999f-7efa5eff6de1 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.560034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab5bb3-76a6-4298-999f-7efa5eff6de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.560413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab5bb3-76a6-4298-999f-7efa5eff6de1 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.561112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab5bb3-76a6-4298-999f-7efa5eff6de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.563061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab5bb3-76a6-4298-999f-7efa5eff6de1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.582684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] The token cache is being invalidate because project 0ffe9aa450ba4ac8b4645f39d8358f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:10.582981 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:10.583635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:10.585279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 964/1935] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:10 2021] DELETE /identity/v3/projects/0ffe9aa450ba4ac8b4645f39d8358f66 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:10.589238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.590570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:10.636763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 972/1936] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:10 2021] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:10.638035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab5bb3-76a6-4298-999f-7efa5eff6de1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.639782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8fab5bb3-76a6-4298-999f-7efa5eff6de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:10.652744 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab5bb3-76a6-4298-999f-7efa5eff6de1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.657648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f35a0-2c1a-467b-a272-3f0dec2cf477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.658322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f35a0-2c1a-467b-a272-3f0dec2cf477 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.658605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f35a0-2c1a-467b-a272-3f0dec2cf477 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.659154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f35a0-2c1a-467b-a272-3f0dec2cf477 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.659840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f35a0-2c1a-467b-a272-3f0dec2cf477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.661508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f35a0-2c1a-467b-a272-3f0dec2cf477 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.670088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df5ea9-e967-4585-9105-23f955b28826 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.674133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 973/1937] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:10 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:10.681274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f35a0-2c1a-467b-a272-3f0dec2cf477 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.682770 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.682904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.683137 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.683446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] PATH_INFO: `/v3/users/082ae6bf1b3b4da99e0bfce9969eb31f` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.685351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] RBAC: Authorizing `identity:delete_user(user_id=082ae6bf1b3b4da99e0bfce9969eb31f)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.687338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.699595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f35a0-2c1a-467b-a272-3f0dec2cf477 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.705719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc29c0d-2ec5-4289-b62b-c44dedf9553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.706919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc29c0d-2ec5-4289-b62b-c44dedf9553b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.707207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc29c0d-2ec5-4289-b62b-c44dedf9553b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.707484 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc29c0d-2ec5-4289-b62b-c44dedf9553b admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.708614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc29c0d-2ec5-4289-b62b-c44dedf9553b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.711021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc29c0d-2ec5-4289-b62b-c44dedf9553b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.725021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 974/1938] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:10 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:10.728871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc29c0d-2ec5-4289-b62b-c44dedf9553b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.740509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc29c0d-2ec5-4289-b62b-c44dedf9553b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.745834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61277a32-3f57-4fba-bcd1-a56288dfa244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.747479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277a32-3f57-4fba-bcd1-a56288dfa244 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.747762 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277a32-3f57-4fba-bcd1-a56288dfa244 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.748035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277a32-3f57-4fba-bcd1-a56288dfa244 admin admin] PATH_INFO: `/v3/projects/d774b573643947ed99aa523db604b985/users/f4435f6fb8204cc59ee0e6c4f2ed2e1a/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.764101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61277a32-3f57-4fba-bcd1-a56288dfa244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d774b573643947ed99aa523db604b985, user_id=f4435f6fb8204cc59ee0e6c4f2ed2e1a, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.767477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61277a32-3f57-4fba-bcd1-a56288dfa244 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.915820 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 975/1939] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:10 2021] PUT /identity/v3/projects/d774b573643947ed99aa523db604b985/users/f4435f6fb8204cc59ee0e6c4f2ed2e1a/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:10.927378 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2364720-38ff-4ad9-ba7b-d6ce9892fe3d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.927923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2364720-38ff-4ad9-ba7b-d6ce9892fe3d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.927923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2364720-38ff-4ad9-ba7b-d6ce9892fe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.946997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '082ae6bf1b3b4da99e0bfce9969eb31f'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:10.957322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e2364720-38ff-4ad9-ba7b-d6ce9892fe3d None None] MFA Rules not processed for user `f4435f6fb8204cc59ee0e6c4f2ed2e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:10.958555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e2364720-38ff-4ad9-ba7b-d6ce9892fe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:10.966629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '082ae6bf1b3b4da99e0bfce9969eb31f'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:10.967746 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '082ae6bf1b3b4da99e0bfce9969eb31f'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:10.984044 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '082ae6bf1b3b4da99e0bfce9969eb31f'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:11.036919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 976/1940] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:10 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:11.041540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2364720-38ff-4ad9-ba7b-d6ce9892fe3d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:11.074213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '082ae6bf1b3b4da99e0bfce9969eb31f'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:11.082206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 965/1941] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:10 2021] DELETE /identity/v3/users/082ae6bf1b3b4da99e0bfce9969eb31f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:11.109132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2364720-38ff-4ad9-ba7b-d6ce9892fe3d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:11.250314 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d4eb-c926-48e2-bd27-6a1a63057989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:11.251004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d4eb-c926-48e2-bd27-6a1a63057989 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:11.251293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d4eb-c926-48e2-bd27-6a1a63057989 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:11.251573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d4eb-c926-48e2-bd27-6a1a63057989 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:11.252283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8d4eb-c926-48e2-bd27-6a1a63057989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:11.254473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8d4eb-c926-48e2-bd27-6a1a63057989 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:11.356513 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 977/1942] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:11 2021] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:11.358514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:11.360127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:11.375500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a464f0-8d6e-445c-99e7-81c5d395049e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:11.436662 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd1b22-e21d-45f4-8dfd-203c112e8381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:11.437653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd1b22-e21d-45f4-8dfd-203c112e8381 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:11.438142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd1b22-e21d-45f4-8dfd-203c112e8381 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:11.438424 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd1b22-e21d-45f4-8dfd-203c112e8381 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:11.439119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd1b22-e21d-45f4-8dfd-203c112e8381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:11.441084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd1b22-e21d-45f4-8dfd-203c112e8381 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:11.600938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 966/1943] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:11 2021] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:11.606184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d4eb-c926-48e2-bd27-6a1a63057989 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:11.616567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d4eb-c926-48e2-bd27-6a1a63057989 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:11.621096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f948f-00a4-4c33-9b05-cce1d9d5aa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:11.622242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f948f-00a4-4c33-9b05-cce1d9d5aa07 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:11.624703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f948f-00a4-4c33-9b05-cce1d9d5aa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:11.624703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f948f-00a4-4c33-9b05-cce1d9d5aa07 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:11.624703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f948f-00a4-4c33-9b05-cce1d9d5aa07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:11.625166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f948f-00a4-4c33-9b05-cce1d9d5aa07 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:11.635549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 978/1944] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:11.640592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd1b22-e21d-45f4-8dfd-203c112e8381 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:11.650996 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f948f-00a4-4c33-9b05-cce1d9d5aa07 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:11.651464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd1b22-e21d-45f4-8dfd-203c112e8381 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:11.653190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b69f948f-00a4-4c33-9b05-cce1d9d5aa07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:11.656744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be48833-5e56-4aac-9b57-36a75e846bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:11.657645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be48833-5e56-4aac-9b57-36a75e846bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:11.657976 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be48833-5e56-4aac-9b57-36a75e846bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:11.658245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be48833-5e56-4aac-9b57-36a75e846bf0 admin admin] PATH_INFO: `/v3/projects/41af205ca4c54d6b8e96f73ec7c95427/users/3ae14c6c76df42ea9881ae835b7fa88d/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:11.671772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f948f-00a4-4c33-9b05-cce1d9d5aa07 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:11.679582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be48833-5e56-4aac-9b57-36a75e846bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41af205ca4c54d6b8e96f73ec7c95427, user_id=3ae14c6c76df42ea9881ae835b7fa88d, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:11.682631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be48833-5e56-4aac-9b57-36a75e846bf0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:11.684294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:11.685195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:11.685493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:11.685762 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] PATH_INFO: `/v3/projects/312b35cfcca24f8cb416f0e9396fb453` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:11.687537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=312b35cfcca24f8cb416f0e9396fb453)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:11.689156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:11.776865 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 967/1945] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:11 2021] PUT /identity/v3/projects/41af205ca4c54d6b8e96f73ec7c95427/users/3ae14c6c76df42ea9881ae835b7fa88d/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:11.781272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be48833-5e56-4aac-9b57-36a75e846bf0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:11.842062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be48833-5e56-4aac-9b57-36a75e846bf0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:11.845704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312b35cfcca24f8cb416f0e9396fb453', 'request_id': 'req-89cf88e2-a063-4a60-8f6a-5891f9093e3d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:11.897061 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc633b7-0f31-4e0b-bec4-179bb9d6f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:11.897744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc633b7-0f31-4e0b-bec4-179bb9d6f3cd admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:11.898031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc633b7-0f31-4e0b-bec4-179bb9d6f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:11.898311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc633b7-0f31-4e0b-bec4-179bb9d6f3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:11.899069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc633b7-0f31-4e0b-bec4-179bb9d6f3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:11.900764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc633b7-0f31-4e0b-bec4-179bb9d6f3cd admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:11.914948 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 968/1946] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:11 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:11.916096 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc633b7-0f31-4e0b-bec4-179bb9d6f3cd admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:11.928528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc633b7-0f31-4e0b-bec4-179bb9d6f3cd admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:11.937660 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719d2bb-58fe-4938-865d-e46ec3023073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:11.938615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d2bb-58fe-4938-865d-e46ec3023073 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:11.939260 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d2bb-58fe-4938-865d-e46ec3023073 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:11.939805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d2bb-58fe-4938-865d-e46ec3023073 admin admin] PATH_INFO: `/v3/projects/41af205ca4c54d6b8e96f73ec7c95427/users/3ae14c6c76df42ea9881ae835b7fa88d/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:11.941890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719d2bb-58fe-4938-865d-e46ec3023073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41af205ca4c54d6b8e96f73ec7c95427, user_id=3ae14c6c76df42ea9881ae835b7fa88d, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:11.945800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719d2bb-58fe-4938-865d-e46ec3023073 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:11.957059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 969/1947] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:11 2021] PUT /identity/v3/projects/41af205ca4c54d6b8e96f73ec7c95427/users/3ae14c6c76df42ea9881ae835b7fa88d/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:11.959382 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312b35cfcca24f8cb416f0e9396fb453', 'request_id': 'req-89cf88e2-a063-4a60-8f6a-5891f9093e3d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:11.964961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b7032-a1fa-4b4f-aad7-d2751b5b47f8 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:11.966057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312b35cfcca24f8cb416f0e9396fb453', 'request_id': 'req-89cf88e2-a063-4a60-8f6a-5891f9093e3d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:11.968040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b7032-a1fa-4b4f-aad7-d2751b5b47f8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:11.968040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b7032-a1fa-4b4f-aad7-d2751b5b47f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:11.979028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] The token cache is being invalidate because project 312b35cfcca24f8cb416f0e9396fb453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:11.979453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:11.980438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-89cf88e2-a063-4a60-8f6a-5891f9093e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:11.987750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 979/1948] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:11 2021] DELETE /identity/v3/projects/312b35cfcca24f8cb416f0e9396fb453 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:11.989605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9134-e241-4300-a767-e96017cb4f87 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:11.990681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9134-e241-4300-a767-e96017cb4f87 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:11.991220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9134-e241-4300-a767-e96017cb4f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.003040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-eb6b7032-a1fa-4b4f-aad7-d2751b5b47f8 None None] MFA Rules not processed for user `e87c6b2f12d04a6d8929e960e6268761`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:12.004876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-eb6b7032-a1fa-4b4f-aad7-d2751b5b47f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:12.025982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-717c9134-e241-4300-a767-e96017cb4f87 None None] MFA Rules not processed for user `3ae14c6c76df42ea9881ae835b7fa88d`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:12.027203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-717c9134-e241-4300-a767-e96017cb4f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:12.074027 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 970/1949] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:11 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:12.075374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a77d-d7d9-485e-9c7c-4f1003dd31b7 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.075934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a77d-d7d9-485e-9c7c-4f1003dd31b7 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.075934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a77d-d7d9-485e-9c7c-4f1003dd31b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.095908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-7636a77d-d7d9-485e-9c7c-4f1003dd31b7 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:12.097266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7636a77d-d7d9-485e-9c7c-4f1003dd31b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:12.107238 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 980/1950] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:11 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:12.117276 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c9134-e241-4300-a767-e96017cb4f87 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:12.119041 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-717c9134-e241-4300-a767-e96017cb4f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:12.180930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 971/1951] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:12.183017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c9134-e241-4300-a767-e96017cb4f87 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:12.189394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c24c4b-c453-404c-b870-820f3f05c7ad None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.189963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c24c4b-c453-404c-b870-820f3f05c7ad None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.189963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c24c4b-c453-404c-b870-820f3f05c7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.190711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345472f-8102-4f57-994c-1c4d62747739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:12.191487 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345472f-8102-4f57-994c-1c4d62747739 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.191988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345472f-8102-4f57-994c-1c4d62747739 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.192454 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345472f-8102-4f57-994c-1c4d62747739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.194406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1345472f-8102-4f57-994c-1c4d62747739 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:12.208335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-03c24c4b-c453-404c-b870-820f3f05c7ad None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:12.209564 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-03c24c4b-c453-404c-b870-820f3f05c7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:12.217929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 972/1952] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:12.222200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c24c4b-c453-404c-b870-820f3f05c7ad None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:12.234064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c24c4b-c453-404c-b870-820f3f05c7ad None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:12.257550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092ec7c-58e4-4b43-9dc6-a64f76c619e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:12.258226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092ec7c-58e4-4b43-9dc6-a64f76c619e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.258506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092ec7c-58e4-4b43-9dc6-a64f76c619e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.258779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092ec7c-58e4-4b43-9dc6-a64f76c619e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.259502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092ec7c-58e4-4b43-9dc6-a64f76c619e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:12.259803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092ec7c-58e4-4b43-9dc6-a64f76c619e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:12.261621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092ec7c-58e4-4b43-9dc6-a64f76c619e4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:12.267887 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345472f-8102-4f57-994c-1c4d62747739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:12.270419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345472f-8102-4f57-994c-1c4d62747739 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:12.275019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 973/1953] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:45:12.279955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092ec7c-58e4-4b43-9dc6-a64f76c619e4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:12.287385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 981/1954] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:12 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:12.296435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092ec7c-58e4-4b43-9dc6-a64f76c619e4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:12.302562 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cec0b1-b316-4156-8488-dbdc737d08b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:12.302562 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cec0b1-b316-4156-8488-dbdc737d08b6 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.303435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cec0b1-b316-4156-8488-dbdc737d08b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.303435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cec0b1-b316-4156-8488-dbdc737d08b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.303602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cec0b1-b316-4156-8488-dbdc737d08b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:12.305561 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cec0b1-b316-4156-8488-dbdc737d08b6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:12.437858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 974/1955] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:12 2021] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:12.439558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345472f-8102-4f57-994c-1c4d62747739 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:12.455696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345472f-8102-4f57-994c-1c4d62747739 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:12.582144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e3923-f177-48aa-bb28-ddc43f21ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:12.583136 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3923-f177-48aa-bb28-ddc43f21ec10 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.583629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3923-f177-48aa-bb28-ddc43f21ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.584050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3923-f177-48aa-bb28-ddc43f21ec10 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.585154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e3923-f177-48aa-bb28-ddc43f21ec10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:12.587575 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e3923-f177-48aa-bb28-ddc43f21ec10 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:12.676436 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 982/1956] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:12 2021] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:12.680409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cec0b1-b316-4156-8488-dbdc737d08b6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:12.693215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cec0b1-b316-4156-8488-dbdc737d08b6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:12.698608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e74de3-816f-49b1-8055-eca1a72758d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:12.699307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e74de3-816f-49b1-8055-eca1a72758d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.700129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e74de3-816f-49b1-8055-eca1a72758d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.700433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e74de3-816f-49b1-8055-eca1a72758d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.701226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e74de3-816f-49b1-8055-eca1a72758d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:12.702861 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e74de3-816f-49b1-8055-eca1a72758d6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:12.717196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 975/1957] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:12 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:12.721023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e3923-f177-48aa-bb28-ddc43f21ec10 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:12.740173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e3923-f177-48aa-bb28-ddc43f21ec10 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:12.749919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5fe0-40c8-4cbc-b1b8-83515a7a4b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:12.751297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5fe0-40c8-4cbc-b1b8-83515a7a4b8b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.751642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5fe0-40c8-4cbc-b1b8-83515a7a4b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.751928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5fe0-40c8-4cbc-b1b8-83515a7a4b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.753832 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5fe0-40c8-4cbc-b1b8-83515a7a4b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:12.755683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5fe0-40c8-4cbc-b1b8-83515a7a4b8b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:12.769580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 983/1958] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:12 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:12.772682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e74de3-816f-49b1-8055-eca1a72758d6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:12.783702 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e74de3-816f-49b1-8055-eca1a72758d6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:12.788471 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8bb89-ea29-4f74-8936-6768c3d090ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:12.789371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8bb89-ea29-4f74-8936-6768c3d090ed admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.789644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8bb89-ea29-4f74-8936-6768c3d090ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.790084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8bb89-ea29-4f74-8936-6768c3d090ed admin admin] PATH_INFO: `/v3/projects/dd76e0e6f1d649f8baf77b7f00686c9d/users/ed979e3eae704d68a663365f8872b50b/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.806591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8bb89-ea29-4f74-8936-6768c3d090ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd76e0e6f1d649f8baf77b7f00686c9d, user_id=ed979e3eae704d68a663365f8872b50b, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:12.809348 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8bb89-ea29-4f74-8936-6768c3d090ed admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:12.984266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 976/1959] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:12 2021] PUT /identity/v3/projects/dd76e0e6f1d649f8baf77b7f00686c9d/users/ed979e3eae704d68a663365f8872b50b/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:12.995664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ddfa2-3043-4ee3-a174-e514934ee23c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.996160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ddfa2-3043-4ee3-a174-e514934ee23c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.997634 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ddfa2-3043-4ee3-a174-e514934ee23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:13.052164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-217ddfa2-3043-4ee3-a174-e514934ee23c None None] MFA Rules not processed for user `ed979e3eae704d68a663365f8872b50b`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:13.053657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-217ddfa2-3043-4ee3-a174-e514934ee23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:13.147936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 984/1960] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:12 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:13.152867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8bb89-ea29-4f74-8936-6768c3d090ed admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:13.229473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8bb89-ea29-4f74-8936-6768c3d090ed admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:13.236054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf067a31-3039-4933-86ce-8e34f69a7d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:13.237038 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf067a31-3039-4933-86ce-8e34f69a7d3c admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:13.237417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf067a31-3039-4933-86ce-8e34f69a7d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:13.237787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf067a31-3039-4933-86ce-8e34f69a7d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:13.238637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf067a31-3039-4933-86ce-8e34f69a7d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:13.241314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf067a31-3039-4933-86ce-8e34f69a7d3c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:13.343151 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 977/1961] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:13 2021] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:13.347159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ddfa2-3043-4ee3-a174-e514934ee23c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:13.358837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ddfa2-3043-4ee3-a174-e514934ee23c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:13.460625 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cb5ec-ca70-4c27-a0c2-920ddc3750b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:13.461681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cb5ec-ca70-4c27-a0c2-920ddc3750b1 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:13.461965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cb5ec-ca70-4c27-a0c2-920ddc3750b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:13.462245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cb5ec-ca70-4c27-a0c2-920ddc3750b1 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:13.463064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cb5ec-ca70-4c27-a0c2-920ddc3750b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:13.465293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cb5ec-ca70-4c27-a0c2-920ddc3750b1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:13.542753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 985/1962] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:13 2021] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:13.547442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf067a31-3039-4933-86ce-8e34f69a7d3c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:13.558099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf067a31-3039-4933-86ce-8e34f69a7d3c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:13.564454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885eb7e-825d-4d0a-9d92-a02851038159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:13.565157 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885eb7e-825d-4d0a-9d92-a02851038159 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:13.565436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885eb7e-825d-4d0a-9d92-a02851038159 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:13.565710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885eb7e-825d-4d0a-9d92-a02851038159 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:13.566444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885eb7e-825d-4d0a-9d92-a02851038159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:13.568044 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885eb7e-825d-4d0a-9d92-a02851038159 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:13.580250 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 978/1963] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:13 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:13.585037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cb5ec-ca70-4c27-a0c2-920ddc3750b1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:13.595373 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cb5ec-ca70-4c27-a0c2-920ddc3750b1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:13.603749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d39fb4-e264-45d5-9b54-98d6d24d6dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:13.603749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d39fb4-e264-45d5-9b54-98d6d24d6dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:13.603749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d39fb4-e264-45d5-9b54-98d6d24d6dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:13.603749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d39fb4-e264-45d5-9b54-98d6d24d6dbb admin admin] PATH_INFO: `/v3/projects/09781c934558438db9d24306a96d0568/users/aea07abc98a547ca8c8ecc98b7b32fd6/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:13.618675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d39fb4-e264-45d5-9b54-98d6d24d6dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=09781c934558438db9d24306a96d0568, user_id=aea07abc98a547ca8c8ecc98b7b32fd6, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:13.622530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d39fb4-e264-45d5-9b54-98d6d24d6dbb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:13.767802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 986/1964] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:13 2021] PUT /identity/v3/projects/09781c934558438db9d24306a96d0568/users/aea07abc98a547ca8c8ecc98b7b32fd6/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:13.771056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885eb7e-825d-4d0a-9d92-a02851038159 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:13.785144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885eb7e-825d-4d0a-9d92-a02851038159 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:13.862502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41388e-528a-43ca-8bc4-f3b2569bb393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:13.863199 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41388e-528a-43ca-8bc4-f3b2569bb393 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:13.863483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41388e-528a-43ca-8bc4-f3b2569bb393 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:13.863758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41388e-528a-43ca-8bc4-f3b2569bb393 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:13.864535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41388e-528a-43ca-8bc4-f3b2569bb393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:13.866378 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41388e-528a-43ca-8bc4-f3b2569bb393 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:13.877950 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 979/1965] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:13 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:13.882331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d39fb4-e264-45d5-9b54-98d6d24d6dbb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:13.894399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d39fb4-e264-45d5-9b54-98d6d24d6dbb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:13.899900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c382fa-139f-45e2-87fd-e6784529c9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:13.900851 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c382fa-139f-45e2-87fd-e6784529c9de admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:13.901133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c382fa-139f-45e2-87fd-e6784529c9de admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:13.901408 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c382fa-139f-45e2-87fd-e6784529c9de admin admin] PATH_INFO: `/v3/projects/09781c934558438db9d24306a96d0568/users/aea07abc98a547ca8c8ecc98b7b32fd6/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:13.907077 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c382fa-139f-45e2-87fd-e6784529c9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=09781c934558438db9d24306a96d0568, user_id=aea07abc98a547ca8c8ecc98b7b32fd6, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:13.907712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c382fa-139f-45e2-87fd-e6784529c9de admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:13.928422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 987/1966] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:13 2021] PUT /identity/v3/projects/09781c934558438db9d24306a96d0568/users/aea07abc98a547ca8c8ecc98b7b32fd6/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:13.940874 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56de31-3724-4034-94a3-5815e4f68e7b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:13.941578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56de31-3724-4034-94a3-5815e4f68e7b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:13.941578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56de31-3724-4034-94a3-5815e4f68e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:13.984727 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ef56de31-3724-4034-94a3-5815e4f68e7b None None] MFA Rules not processed for user `aea07abc98a547ca8c8ecc98b7b32fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:13.986274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ef56de31-3724-4034-94a3-5815e4f68e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:14.081337 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 980/1967] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:13 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:14.094002 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c382fa-139f-45e2-87fd-e6784529c9de admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:14.161986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c382fa-139f-45e2-87fd-e6784529c9de admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:14.165947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8268e-afba-47a8-af84-4c45ab2044e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:14.166605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8268e-afba-47a8-af84-4c45ab2044e1 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:14.166888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8268e-afba-47a8-af84-4c45ab2044e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:14.167193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8268e-afba-47a8-af84-4c45ab2044e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:14.177199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8268e-afba-47a8-af84-4c45ab2044e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:14.178724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8268e-afba-47a8-af84-4c45ab2044e1 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:14.189080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 988/1968] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:14 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:14.337630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56de31-3724-4034-94a3-5815e4f68e7b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:14.339148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ef56de31-3724-4034-94a3-5815e4f68e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:14.360914 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56de31-3724-4034-94a3-5815e4f68e7b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:14.369115 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab362-5969-468d-858f-e68a71a057cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:14.369804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab362-5969-468d-858f-e68a71a057cd service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:14.370293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab362-5969-468d-858f-e68a71a057cd service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:14.370578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab362-5969-468d-858f-e68a71a057cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:14.467654 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ab362-5969-468d-858f-e68a71a057cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:14.469687 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ab362-5969-468d-858f-e68a71a057cd service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:14.482452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 981/1969] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:14 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:14.763787 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8268e-afba-47a8-af84-4c45ab2044e1 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:14.772150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8268e-afba-47a8-af84-4c45ab2044e1 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:14.775817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd71ab8-2915-4acb-b76d-221ddbb07391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:14.776495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd71ab8-2915-4acb-b76d-221ddbb07391 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:14.776770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd71ab8-2915-4acb-b76d-221ddbb07391 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:14.777107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd71ab8-2915-4acb-b76d-221ddbb07391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:14.778889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2cd71ab8-2915-4acb-b76d-221ddbb07391 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:14.825306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab362-5969-468d-858f-e68a71a057cd service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:14.861056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd71ab8-2915-4acb-b76d-221ddbb07391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:14.862869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd71ab8-2915-4acb-b76d-221ddbb07391 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:14.889157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 989/1970] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:14 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:14.918585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab362-5969-468d-858f-e68a71a057cd service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:14.929052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:14.929982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:14.930263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:14.930537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] PATH_INFO: `/v3/users/ed979e3eae704d68a663365f8872b50b` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:14.936586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed979e3eae704d68a663365f8872b50b)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:14.936586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:15.216001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed979e3eae704d68a663365f8872b50b'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.242392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed979e3eae704d68a663365f8872b50b'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.243637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed979e3eae704d68a663365f8872b50b'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.253751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed979e3eae704d68a663365f8872b50b'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.364244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed979e3eae704d68a663365f8872b50b'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.373018 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 982/1971] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:14 2021] DELETE /identity/v3/users/ed979e3eae704d68a663365f8872b50b => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:15.377757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70d30f-0f24-42e4-adae-e2ebac26bdfc None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:15.378337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70d30f-0f24-42e4-adae-e2ebac26bdfc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:15.378430 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70d30f-0f24-42e4-adae-e2ebac26bdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:15.397058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0d70d30f-0f24-42e4-adae-e2ebac26bdfc None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:15.403776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0d70d30f-0f24-42e4-adae-e2ebac26bdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:15.485785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 990/1972] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:15.493788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:15.495497 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:15.583053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9bd56-5490-4c39-8746-638e659e3260 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:15.616113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776178f-f524-4b2d-9173-056c1a2cc5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:15.617161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776178f-f524-4b2d-9173-056c1a2cc5bb service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:15.618238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776178f-f524-4b2d-9173-056c1a2cc5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:15.620218 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776178f-f524-4b2d-9173-056c1a2cc5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:15.639327 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776178f-f524-4b2d-9173-056c1a2cc5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:15.642890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776178f-f524-4b2d-9173-056c1a2cc5bb service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:15.655807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 983/1973] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:16.425314 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70d30f-0f24-42e4-adae-e2ebac26bdfc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:16.429441 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0d70d30f-0f24-42e4-adae-e2ebac26bdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:16.442279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70d30f-0f24-42e4-adae-e2ebac26bdfc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:16.475091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:16.475979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:16.476954 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:16.478709 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] PATH_INFO: `/v3/projects/dd76e0e6f1d649f8baf77b7f00686c9d` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:16.480864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd76e0e6f1d649f8baf77b7f00686c9d)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:16.483503 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:16.652033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd76e0e6f1d649f8baf77b7f00686c9d', 'request_id': 'req-df666003-f480-477d-9075-4deaf53a10d7'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:16.737669 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd76e0e6f1d649f8baf77b7f00686c9d', 'request_id': 'req-df666003-f480-477d-9075-4deaf53a10d7'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:16.746841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd76e0e6f1d649f8baf77b7f00686c9d', 'request_id': 'req-df666003-f480-477d-9075-4deaf53a10d7'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:16.759953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] The token cache is being invalidate because project dd76e0e6f1d649f8baf77b7f00686c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:16.760590 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:16.761614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:16.765644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 991/1974] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:16 2021] DELETE /identity/v3/projects/dd76e0e6f1d649f8baf77b7f00686c9d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:16.769715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776178f-f524-4b2d-9173-056c1a2cc5bb service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:16.780917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776178f-f524-4b2d-9173-056c1a2cc5bb service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:16.842479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:16.843447 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:16.843731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:16.844009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] PATH_INFO: `/v3/users/aea07abc98a547ca8c8ecc98b7b32fd6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:16.845565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea07abc98a547ca8c8ecc98b7b32fd6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:16.847650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:17.096455 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea07abc98a547ca8c8ecc98b7b32fd6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.110278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea07abc98a547ca8c8ecc98b7b32fd6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.111006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea07abc98a547ca8c8ecc98b7b32fd6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.118291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea07abc98a547ca8c8ecc98b7b32fd6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.226277 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea07abc98a547ca8c8ecc98b7b32fd6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.234800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 984/1975] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:16 2021] DELETE /identity/v3/users/aea07abc98a547ca8c8ecc98b7b32fd6 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:17.442011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:17.443408 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:17.520631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666003-f480-477d-9075-4deaf53a10d7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:17.576134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc5ff2-cf51-4bb4-bab9-16452bec95e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:17.576993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc5ff2-cf51-4bb4-bab9-16452bec95e4 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:17.577354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc5ff2-cf51-4bb4-bab9-16452bec95e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:17.577695 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc5ff2-cf51-4bb4-bab9-16452bec95e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:17.579840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-33bc5ff2-cf51-4bb4-bab9-16452bec95e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:17.648844 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc5ff2-cf51-4bb4-bab9-16452bec95e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:17.650226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc5ff2-cf51-4bb4-bab9-16452bec95e4 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:17.672111 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 992/1976] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:17 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:17.893749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:17.896463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:17.998754 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034d18d-a6eb-4257-9498-c6799569da14 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:18.003647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:18.004563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.004841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.005318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] PATH_INFO: `/v3/projects/09781c934558438db9d24306a96d0568` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.006570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09781c934558438db9d24306a96d0568)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:18.008568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:18.143364 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09781c934558438db9d24306a96d0568', 'request_id': 'req-616d82c1-4da3-4d88-8753-b3629a36c119'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.162249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09781c934558438db9d24306a96d0568', 'request_id': 'req-616d82c1-4da3-4d88-8753-b3629a36c119'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.162249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09781c934558438db9d24306a96d0568', 'request_id': 'req-616d82c1-4da3-4d88-8753-b3629a36c119'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.284138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] The token cache is being invalidate because project 09781c934558438db9d24306a96d0568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:18.284482 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.285123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-616d82c1-4da3-4d88-8753-b3629a36c119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.287029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 985/1977] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:17 2021] DELETE /identity/v3/projects/09781c934558438db9d24306a96d0568 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:18.295711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e95629-b74e-4fb3-955f-f1d8215caba2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.296155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e95629-b74e-4fb3-955f-f1d8215caba2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.296598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e95629-b74e-4fb3-955f-f1d8215caba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.317843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-a8e95629-b74e-4fb3-955f-f1d8215caba2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:18.319190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a8e95629-b74e-4fb3-955f-f1d8215caba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:18.389325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 993/1978] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:18.393121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc19ccf-8da2-4a10-b374-cad6643c2d94 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.393445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc19ccf-8da2-4a10-b374-cad6643c2d94 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.393723 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc19ccf-8da2-4a10-b374-cad6643c2d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.535300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-cbc19ccf-8da2-4a10-b374-cad6643c2d94 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:18.535300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-cbc19ccf-8da2-4a10-b374-cad6643c2d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:18.535300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 986/1979] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:18.536250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e95629-b74e-4fb3-955f-f1d8215caba2 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:18.536250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e95629-b74e-4fb3-955f-f1d8215caba2 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:18.536250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3b220-f51a-4ea4-b841-f99e0ba31ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:18.536250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b220-f51a-4ea4-b841-f99e0ba31ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.537021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b220-f51a-4ea4-b841-f99e0ba31ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.537021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b220-f51a-4ea4-b841-f99e0ba31ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.537021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3b220-f51a-4ea4-b841-f99e0ba31ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:18.537021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3b220-f51a-4ea4-b841-f99e0ba31ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:18.537021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3b220-f51a-4ea4-b841-f99e0ba31ed8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:18.537021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 994/1980] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:18.537488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc19ccf-8da2-4a10-b374-cad6643c2d94 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:18.537488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc19ccf-8da2-4a10-b374-cad6643c2d94 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:18.537488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db3f63-b828-48cd-880c-1b52e76d5786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:18.537488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3f63-b828-48cd-880c-1b52e76d5786 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.537797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3f63-b828-48cd-880c-1b52e76d5786 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.537797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3f63-b828-48cd-880c-1b52e76d5786 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.537797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db3f63-b828-48cd-880c-1b52e76d5786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:18.537797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db3f63-b828-48cd-880c-1b52e76d5786 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:18.846793 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 987/1981] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:18 2021] POST /identity/v3/projects => generated 373 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:18.850795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3b220-f51a-4ea4-b841-f99e0ba31ed8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:18.861279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3b220-f51a-4ea4-b841-f99e0ba31ed8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:18.916713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd706f5-5959-41ae-b22f-ca0c579a336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:18.917387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd706f5-5959-41ae-b22f-ca0c579a336b admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.917670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd706f5-5959-41ae-b22f-ca0c579a336b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.918076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd706f5-5959-41ae-b22f-ca0c579a336b admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.919332 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd706f5-5959-41ae-b22f-ca0c579a336b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:18.921304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd706f5-5959-41ae-b22f-ca0c579a336b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.057612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 995/1982] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:18 2021] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:19.060095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db3f63-b828-48cd-880c-1b52e76d5786 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.070617 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db3f63-b828-48cd-880c-1b52e76d5786 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.075577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7ac4f-1a89-4cd0-a805-23c046e92645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.076533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ac4f-1a89-4cd0-a805-23c046e92645 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.077442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ac4f-1a89-4cd0-a805-23c046e92645 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.077442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ac4f-1a89-4cd0-a805-23c046e92645 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.078119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7ac4f-1a89-4cd0-a805-23c046e92645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.079889 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7ac4f-1a89-4cd0-a805-23c046e92645 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.090876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 988/1983] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:19.094955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd706f5-5959-41ae-b22f-ca0c579a336b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.104902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd706f5-5959-41ae-b22f-ca0c579a336b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.110276 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befabdc6-c8ac-4d14-a072-e12dcac9a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.110947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befabdc6-c8ac-4d14-a072-e12dcac9a013 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.111235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befabdc6-c8ac-4d14-a072-e12dcac9a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.111515 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befabdc6-c8ac-4d14-a072-e12dcac9a013 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.112248 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befabdc6-c8ac-4d14-a072-e12dcac9a013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.113944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befabdc6-c8ac-4d14-a072-e12dcac9a013 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.124464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 996/1984] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:19.128820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7ac4f-1a89-4cd0-a805-23c046e92645 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.138903 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7ac4f-1a89-4cd0-a805-23c046e92645 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.143813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a46370-0f21-4646-8945-1c4cad0ed1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.144733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46370-0f21-4646-8945-1c4cad0ed1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.145183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46370-0f21-4646-8945-1c4cad0ed1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.145602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46370-0f21-4646-8945-1c4cad0ed1e1 admin admin] PATH_INFO: `/v3/projects/1b4896c619ff4294bd661dbfafe11cc5/users/f738569e2cc540f6bccb96bd5c3ba9a6/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.162579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a46370-0f21-4646-8945-1c4cad0ed1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4896c619ff4294bd661dbfafe11cc5, user_id=f738569e2cc540f6bccb96bd5c3ba9a6, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.165346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a46370-0f21-4646-8945-1c4cad0ed1e1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.294736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 989/1985] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:19 2021] PUT /identity/v3/projects/1b4896c619ff4294bd661dbfafe11cc5/users/f738569e2cc540f6bccb96bd5c3ba9a6/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:19.305226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5140f-3445-41d0-87e5-6a0d82387db0 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.305787 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5140f-3445-41d0-87e5-6a0d82387db0 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.306064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5140f-3445-41d0-87e5-6a0d82387db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.333356 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-85a5140f-3445-41d0-87e5-6a0d82387db0 None None] MFA Rules not processed for user `f738569e2cc540f6bccb96bd5c3ba9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:19.334578 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-85a5140f-3445-41d0-87e5-6a0d82387db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:19.399677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 997/1986] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:19 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:19.405191 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a46370-0f21-4646-8945-1c4cad0ed1e1 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.466278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a46370-0f21-4646-8945-1c4cad0ed1e1 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.471098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dbf34-77d2-45e0-a164-781cc4fa98e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.471787 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dbf34-77d2-45e0-a164-781cc4fa98e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.472074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dbf34-77d2-45e0-a164-781cc4fa98e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.472374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dbf34-77d2-45e0-a164-781cc4fa98e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.473086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dbf34-77d2-45e0-a164-781cc4fa98e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.474987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dbf34-77d2-45e0-a164-781cc4fa98e0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.570259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 990/1987] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:19 2021] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:19.574106 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5140f-3445-41d0-87e5-6a0d82387db0 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.585072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5140f-3445-41d0-87e5-6a0d82387db0 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.638972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea09bf-ec6c-405b-8154-1bfd6dcae0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.639649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea09bf-ec6c-405b-8154-1bfd6dcae0df admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.640226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea09bf-ec6c-405b-8154-1bfd6dcae0df admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.640539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea09bf-ec6c-405b-8154-1bfd6dcae0df admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.641228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea09bf-ec6c-405b-8154-1bfd6dcae0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.643161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea09bf-ec6c-405b-8154-1bfd6dcae0df admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.751959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 998/1988] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:19 2021] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:19.755960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dbf34-77d2-45e0-a164-781cc4fa98e0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.767626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dbf34-77d2-45e0-a164-781cc4fa98e0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.772454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cd411-93a2-49df-b686-9b5c2d1bbef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.773122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cd411-93a2-49df-b686-9b5c2d1bbef3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.773403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cd411-93a2-49df-b686-9b5c2d1bbef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.773705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cd411-93a2-49df-b686-9b5c2d1bbef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.774426 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cd411-93a2-49df-b686-9b5c2d1bbef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.776013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cd411-93a2-49df-b686-9b5c2d1bbef3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.786931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 991/1989] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:19.791226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea09bf-ec6c-405b-8154-1bfd6dcae0df admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.801681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea09bf-ec6c-405b-8154-1bfd6dcae0df admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.806347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e381d-24ac-4550-88a2-beadb734a562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.807147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e381d-24ac-4550-88a2-beadb734a562 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.807428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e381d-24ac-4550-88a2-beadb734a562 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.807700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e381d-24ac-4550-88a2-beadb734a562 admin admin] PATH_INFO: `/v3/projects/2d3c5ce3c67c4580a1eccc73c8cd277a/users/02c737575f654411b7148158c04877e6/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.821899 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e381d-24ac-4550-88a2-beadb734a562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3c5ce3c67c4580a1eccc73c8cd277a, user_id=02c737575f654411b7148158c04877e6, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.824677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e381d-24ac-4550-88a2-beadb734a562 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.895099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 999/1990] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:19 2021] PUT /identity/v3/projects/2d3c5ce3c67c4580a1eccc73c8cd277a/users/02c737575f654411b7148158c04877e6/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:19.899178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cd411-93a2-49df-b686-9b5c2d1bbef3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.910112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cd411-93a2-49df-b686-9b5c2d1bbef3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.970691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf7985-92fe-4f42-bf4a-ce1ef7a0264f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.971452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf7985-92fe-4f42-bf4a-ce1ef7a0264f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.971663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf7985-92fe-4f42-bf4a-ce1ef7a0264f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.971938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf7985-92fe-4f42-bf4a-ce1ef7a0264f admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.972714 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf7985-92fe-4f42-bf4a-ce1ef7a0264f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.974320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf7985-92fe-4f42-bf4a-ce1ef7a0264f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.984751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 992/1991] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:19.988830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e381d-24ac-4550-88a2-beadb734a562 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.999129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e381d-24ac-4550-88a2-beadb734a562 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.003852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbbdf8-67dd-45d3-ac38-f048cb06f6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.004777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbbdf8-67dd-45d3-ac38-f048cb06f6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.005058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbbdf8-67dd-45d3-ac38-f048cb06f6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.005340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbbdf8-67dd-45d3-ac38-f048cb06f6a7 admin admin] PATH_INFO: `/v3/projects/2d3c5ce3c67c4580a1eccc73c8cd277a/users/02c737575f654411b7148158c04877e6/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.007307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbbdf8-67dd-45d3-ac38-f048cb06f6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3c5ce3c67c4580a1eccc73c8cd277a, user_id=02c737575f654411b7148158c04877e6, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.010040 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbbdf8-67dd-45d3-ac38-f048cb06f6a7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.021316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1000/1992] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:19 2021] PUT /identity/v3/projects/2d3c5ce3c67c4580a1eccc73c8cd277a/users/02c737575f654411b7148158c04877e6/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:20.035342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a776f8-dd5b-42c5-9657-3290e46a7736 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.035638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a776f8-dd5b-42c5-9657-3290e46a7736 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.035921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a776f8-dd5b-42c5-9657-3290e46a7736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.061970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-c2a776f8-dd5b-42c5-9657-3290e46a7736 None None] MFA Rules not processed for user `02c737575f654411b7148158c04877e6`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:20.063185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c2a776f8-dd5b-42c5-9657-3290e46a7736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:20.129781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 993/1993] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:20 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:20.140344 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbbdf8-67dd-45d3-ac38-f048cb06f6a7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.142046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f8fbbdf8-67dd-45d3-ac38-f048cb06f6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:20.203523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbbdf8-67dd-45d3-ac38-f048cb06f6a7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.207216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1f007-4487-4326-a9a8-4841b25a6b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.207851 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1f007-4487-4326-a9a8-4841b25a6b4e service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.208132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1f007-4487-4326-a9a8-4841b25a6b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.208438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1f007-4487-4326-a9a8-4841b25a6b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.266098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1f007-4487-4326-a9a8-4841b25a6b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.267816 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1f007-4487-4326-a9a8-4841b25a6b4e service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.279503 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1001/1994] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:20 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:26.456132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a776f8-dd5b-42c5-9657-3290e46a7736 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:26.528548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a776f8-dd5b-42c5-9657-3290e46a7736 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:26.534228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:26.535784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:26.536200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:26.536634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] PATH_INFO: `/v3/users/f738569e2cc540f6bccb96bd5c3ba9a6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:26.538201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f738569e2cc540f6bccb96bd5c3ba9a6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:26.540661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:26.852420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f738569e2cc540f6bccb96bd5c3ba9a6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:26.864958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f738569e2cc540f6bccb96bd5c3ba9a6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:26.865679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f738569e2cc540f6bccb96bd5c3ba9a6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:26.873285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f738569e2cc540f6bccb96bd5c3ba9a6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:26.972757 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f738569e2cc540f6bccb96bd5c3ba9a6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:26.982317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 994/1995] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:26 2021] DELETE /identity/v3/users/f738569e2cc540f6bccb96bd5c3ba9a6 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:26.992011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4b2ea-e074-4741-a54d-0e91167f0c0f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:26.992601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4b2ea-e074-4741-a54d-0e91167f0c0f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:26.992601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4b2ea-e074-4741-a54d-0e91167f0c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:27.020009 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-96b4b2ea-e074-4741-a54d-0e91167f0c0f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:27.023070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-96b4b2ea-e074-4741-a54d-0e91167f0c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:27.095687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1002/1996] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:27.110297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:27.114046 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:27.210517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8ed9-15e4-4595-b291-c9c85b59f1fc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:27.216691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4e8d-3850-4995-b9a5-10cf91dd818f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:27.217373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4e8d-3850-4995-b9a5-10cf91dd818f service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:27.218219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4e8d-3850-4995-b9a5-10cf91dd818f service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:27.218819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4e8d-3850-4995-b9a5-10cf91dd818f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:27.232760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4e8d-3850-4995-b9a5-10cf91dd818f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:27.234083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4e8d-3850-4995-b9a5-10cf91dd818f service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:27.245637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 995/1997] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:27.847497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4b2ea-e074-4741-a54d-0e91167f0c0f None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:27.848995 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-96b4b2ea-e074-4741-a54d-0e91167f0c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:27.863109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4b2ea-e074-4741-a54d-0e91167f0c0f None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:27.867953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:27.868861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:27.869131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:27.871867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] PATH_INFO: `/v3/projects/1b4896c619ff4294bd661dbfafe11cc5` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:27.871867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b4896c619ff4294bd661dbfafe11cc5)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:27.873235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:28.020957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b4896c619ff4294bd661dbfafe11cc5', 'request_id': 'req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:28.085355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b4896c619ff4294bd661dbfafe11cc5', 'request_id': 'req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:28.097414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b4896c619ff4294bd661dbfafe11cc5', 'request_id': 'req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:28.110803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] The token cache is being invalidate because project 1b4896c619ff4294bd661dbfafe11cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:28.111099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:28.111984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:28.114019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1003/1998] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:27 2021] DELETE /identity/v3/projects/1b4896c619ff4294bd661dbfafe11cc5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:28.117998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4e8d-3850-4995-b9a5-10cf91dd818f service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:28.129841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4e8d-3850-4995-b9a5-10cf91dd818f service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:28.194593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:28.195476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:28.195764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:28.196045 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] PATH_INFO: `/v3/users/02c737575f654411b7148158c04877e6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:28.197398 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c737575f654411b7148158c04877e6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:28.199931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:28.438166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c737575f654411b7148158c04877e6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:28.450000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c737575f654411b7148158c04877e6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:28.450698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c737575f654411b7148158c04877e6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:28.457265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c737575f654411b7148158c04877e6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:28.528993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c737575f654411b7148158c04877e6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:28.532224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 996/1999] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:28 2021] DELETE /identity/v3/users/02c737575f654411b7148158c04877e6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:29.081782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:29.084011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:29.101717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22d7c0-14b3-42dc-95a2-ee42dbcdcdb6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:29.159951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:29.160880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:29.161163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:29.161452 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] PATH_INFO: `/v3/projects/2d3c5ce3c67c4580a1eccc73c8cd277a` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:29.162948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3c5ce3c67c4580a1eccc73c8cd277a)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:29.165104 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:29.252891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:29.254419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:29.268847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaec363-81bd-4024-9c26-c0c755e00d5c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:29.274130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:29.274983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:29.275251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:29.275520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] PATH_INFO: `/v3/users/9c1fd1406ad649a0b23dc7c710d6ad0c` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:29.276748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1fd1406ad649a0b23dc7c710d6ad0c)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:29.279311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:29.323599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3c5ce3c67c4580a1eccc73c8cd277a', 'request_id': 'req-ad36c10d-7a48-4abe-9d61-b5a3096ded13'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.441424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3c5ce3c67c4580a1eccc73c8cd277a', 'request_id': 'req-ad36c10d-7a48-4abe-9d61-b5a3096ded13'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.451081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3c5ce3c67c4580a1eccc73c8cd277a', 'request_id': 'req-ad36c10d-7a48-4abe-9d61-b5a3096ded13'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.470204 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] The token cache is being invalidate because project 2d3c5ce3c67c4580a1eccc73c8cd277a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:29.471296 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.472547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ad36c10d-7a48-4abe-9d61-b5a3096ded13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.475470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1004/2000] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:29 2021] DELETE /identity/v3/projects/2d3c5ce3c67c4580a1eccc73c8cd277a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:29.481914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29317445-a222-4ac2-866a-5eaf562894fa None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:29.483674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29317445-a222-4ac2-866a-5eaf562894fa None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:29.484020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29317445-a222-4ac2-866a-5eaf562894fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:29.511444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-29317445-a222-4ac2-866a-5eaf562894fa None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:29.513926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-29317445-a222-4ac2-866a-5eaf562894fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:29.539353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1fd1406ad649a0b23dc7c710d6ad0c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.553446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1fd1406ad649a0b23dc7c710d6ad0c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.554294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1fd1406ad649a0b23dc7c710d6ad0c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.563598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1fd1406ad649a0b23dc7c710d6ad0c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.588018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1005/2001] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:29.596559 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ca934-2d14-4aeb-8fe5-f29cbc9e574c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:29.596855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ca934-2d14-4aeb-8fe5-f29cbc9e574c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:29.597155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ca934-2d14-4aeb-8fe5-f29cbc9e574c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:29.616346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-235ca934-2d14-4aeb-8fe5-f29cbc9e574c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:29.617512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-235ca934-2d14-4aeb-8fe5-f29cbc9e574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:29.626140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1006/2002] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:29.630576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ca934-2d14-4aeb-8fe5-f29cbc9e574c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:29.640647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ca934-2d14-4aeb-8fe5-f29cbc9e574c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:29.645729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd79e4e-f36f-469c-9dfa-4b6b93baaaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:29.646262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79e4e-f36f-469c-9dfa-4b6b93baaaeb admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:29.646556 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79e4e-f36f-469c-9dfa-4b6b93baaaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:29.646945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79e4e-f36f-469c-9dfa-4b6b93baaaeb admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:29.648099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd79e4e-f36f-469c-9dfa-4b6b93baaaeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:29.648449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd79e4e-f36f-469c-9dfa-4b6b93baaaeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:29.650090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd79e4e-f36f-469c-9dfa-4b6b93baaaeb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:29.662781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1007/2003] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:45:29.667529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd79e4e-f36f-469c-9dfa-4b6b93baaaeb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:29.673387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e1be6de5-ee1d-470c-b581-1edac1df780f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1fd1406ad649a0b23dc7c710d6ad0c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.683594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 997/2004] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:29 2021] DELETE /identity/v3/users/9c1fd1406ad649a0b23dc7c710d6ad0c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:29.685287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd79e4e-f36f-469c-9dfa-4b6b93baaaeb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:29.686374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74192a1b-edb7-476f-8b78-19a7624514b8 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:29.686667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74192a1b-edb7-476f-8b78-19a7624514b8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:29.687185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74192a1b-edb7-476f-8b78-19a7624514b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:29.706361 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-74192a1b-edb7-476f-8b78-19a7624514b8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:29.708242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-74192a1b-edb7-476f-8b78-19a7624514b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:29.763667 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243d11f-9d83-48cc-89a3-0fe62d5b1bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:29.764507 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243d11f-9d83-48cc-89a3-0fe62d5b1bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:29.765139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243d11f-9d83-48cc-89a3-0fe62d5b1bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:29.765422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243d11f-9d83-48cc-89a3-0fe62d5b1bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:29.766127 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243d11f-9d83-48cc-89a3-0fe62d5b1bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:29.768160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243d11f-9d83-48cc-89a3-0fe62d5b1bb7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:29.773271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 998/2005] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:29.783803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74192a1b-edb7-476f-8b78-19a7624514b8 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:29.785247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-74192a1b-edb7-476f-8b78-19a7624514b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:29.840706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74192a1b-edb7-476f-8b78-19a7624514b8 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:29.845422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552c3e-99cd-48e4-9da1-d01a54686e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:29.846064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552c3e-99cd-48e4-9da1-d01a54686e01 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:29.846342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552c3e-99cd-48e4-9da1-d01a54686e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:29.846611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552c3e-99cd-48e4-9da1-d01a54686e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:29.855509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89552c3e-99cd-48e4-9da1-d01a54686e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:29.863135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89552c3e-99cd-48e4-9da1-d01a54686e01 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:29.866918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 999/2006] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:29.914033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1008/2007] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:29 2021] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:29.915227 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552c3e-99cd-48e4-9da1-d01a54686e01 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:29.916750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-89552c3e-99cd-48e4-9da1-d01a54686e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:29.929627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552c3e-99cd-48e4-9da1-d01a54686e01 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:29.989810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a44e1-d587-4dd6-bbea-6e1add9b1e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:29.990491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a44e1-d587-4dd6-bbea-6e1add9b1e4a admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:29.990776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a44e1-d587-4dd6-bbea-6e1add9b1e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:29.991669 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a44e1-d587-4dd6-bbea-6e1add9b1e4a admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:29.991887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a44e1-d587-4dd6-bbea-6e1add9b1e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:29.993794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a44e1-d587-4dd6-bbea-6e1add9b1e4a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:30.120393 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1000/2008] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:29 2021] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:30.126369 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243d11f-9d83-48cc-89a3-0fe62d5b1bb7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:30.136776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243d11f-9d83-48cc-89a3-0fe62d5b1bb7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:30.141851 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb69d4b-8608-4865-8a9d-f464f3dd3028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:30.142541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb69d4b-8608-4865-8a9d-f464f3dd3028 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:30.142821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb69d4b-8608-4865-8a9d-f464f3dd3028 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:30.143092 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb69d4b-8608-4865-8a9d-f464f3dd3028 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:30.143814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb69d4b-8608-4865-8a9d-f464f3dd3028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:30.145503 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb69d4b-8608-4865-8a9d-f464f3dd3028 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:30.156080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1009/2009] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:30.161673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a44e1-d587-4dd6-bbea-6e1add9b1e4a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:30.172122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a44e1-d587-4dd6-bbea-6e1add9b1e4a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:30.176809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ea214-56b4-4a79-9007-37ab9d475847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:30.177464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ea214-56b4-4a79-9007-37ab9d475847 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:30.177745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ea214-56b4-4a79-9007-37ab9d475847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:30.178019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ea214-56b4-4a79-9007-37ab9d475847 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:30.178828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ea214-56b4-4a79-9007-37ab9d475847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:30.180334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ea214-56b4-4a79-9007-37ab9d475847 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:30.191637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1001/2010] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:30.194870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb69d4b-8608-4865-8a9d-f464f3dd3028 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:30.204711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb69d4b-8608-4865-8a9d-f464f3dd3028 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:30.210195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217010c-b0c7-40a9-bdfe-6fb720e4d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:30.211088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217010c-b0c7-40a9-bdfe-6fb720e4d60d admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:30.211400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217010c-b0c7-40a9-bdfe-6fb720e4d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:30.211682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217010c-b0c7-40a9-bdfe-6fb720e4d60d admin admin] PATH_INFO: `/v3/projects/a105a4a28f9544848cdf60f4e1f9dd6b/users/2393ef84bc4144d5a44300cd98c55f6e/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:30.228225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217010c-b0c7-40a9-bdfe-6fb720e4d60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a105a4a28f9544848cdf60f4e1f9dd6b, user_id=2393ef84bc4144d5a44300cd98c55f6e, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:30.231634 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217010c-b0c7-40a9-bdfe-6fb720e4d60d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:30.350357 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1010/2011] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:30 2021] PUT /identity/v3/projects/a105a4a28f9544848cdf60f4e1f9dd6b/users/2393ef84bc4144d5a44300cd98c55f6e/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:30.350476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ea214-56b4-4a79-9007-37ab9d475847 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:30.359358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-385ea214-56b4-4a79-9007-37ab9d475847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:30.361673 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c538b-e6b8-4f3b-bc04-fbdcdb606096 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:30.361969 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c538b-e6b8-4f3b-bc04-fbdcdb606096 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:30.362243 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c538b-e6b8-4f3b-bc04-fbdcdb606096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:30.379339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ea214-56b4-4a79-9007-37ab9d475847 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:30.398175 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c20c538b-e6b8-4f3b-bc04-fbdcdb606096 None None] MFA Rules not processed for user `2393ef84bc4144d5a44300cd98c55f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:30.399479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c20c538b-e6b8-4f3b-bc04-fbdcdb606096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:30.457195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:30.458383 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:30.458597 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:30.458918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] PATH_INFO: `/v3/projects/77f6057e8c2f494cba500ba65bba7d1a` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:30.469189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f6057e8c2f494cba500ba65bba7d1a)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:30.471161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:30.472953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1011/2012] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:30 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:30.487153 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c538b-e6b8-4f3b-bc04-fbdcdb606096 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:30.489134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c20c538b-e6b8-4f3b-bc04-fbdcdb606096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:30.553162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c538b-e6b8-4f3b-bc04-fbdcdb606096 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:30.556897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5f5b4-3ddf-4641-b3ad-f16068a6aa70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:30.557551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f5b4-3ddf-4641-b3ad-f16068a6aa70 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:30.562434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f5b4-3ddf-4641-b3ad-f16068a6aa70 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:30.562434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f5b4-3ddf-4641-b3ad-f16068a6aa70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:30.567461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5f5b4-3ddf-4641-b3ad-f16068a6aa70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:30.569109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5f5b4-3ddf-4641-b3ad-f16068a6aa70 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:30.578533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1012/2013] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:30 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:30.662556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f6057e8c2f494cba500ba65bba7d1a', 'request_id': 'req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:30.662556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f6057e8c2f494cba500ba65bba7d1a', 'request_id': 'req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:30.675551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f6057e8c2f494cba500ba65bba7d1a', 'request_id': 'req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:30.810274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] The token cache is being invalidate because project 77f6057e8c2f494cba500ba65bba7d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:30.810570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:30.811257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:30.812947 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1002/2014] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:30 2021] DELETE /identity/v3/projects/77f6057e8c2f494cba500ba65bba7d1a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:30.817375 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5f5b4-3ddf-4641-b3ad-f16068a6aa70 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:30.835324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5f5b4-3ddf-4641-b3ad-f16068a6aa70 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:30.896118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:30.897126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:30.897504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:30.898018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] PATH_INFO: `/v3/users/f4435f6fb8204cc59ee0e6c4f2ed2e1a` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:30.899460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4435f6fb8204cc59ee0e6c4f2ed2e1a)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:30.901900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:31.098117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4435f6fb8204cc59ee0e6c4f2ed2e1a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:31.098916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4435f6fb8204cc59ee0e6c4f2ed2e1a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:31.099626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4435f6fb8204cc59ee0e6c4f2ed2e1a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:31.142697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4435f6fb8204cc59ee0e6c4f2ed2e1a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:31.259300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4435f6fb8204cc59ee0e6c4f2ed2e1a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:31.294142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1013/2015] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:30 2021] DELETE /identity/v3/users/f4435f6fb8204cc59ee0e6c4f2ed2e1a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:31.889282 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:31.891319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:31.912530 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08629cf0-60ef-4fbd-a6b9-6b18d1401f41 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:31.983677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:31.984579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:31.984867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:31.985145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] PATH_INFO: `/v3/projects/d774b573643947ed99aa523db604b985` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:31.986446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d774b573643947ed99aa523db604b985)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:31.988384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:32.096242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:32.097815 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:32.103836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd774b573643947ed99aa523db604b985', 'request_id': 'req-963e371f-3609-44da-9b0e-99c2ea9fb2f2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.112071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd774b573643947ed99aa523db604b985', 'request_id': 'req-963e371f-3609-44da-9b0e-99c2ea9fb2f2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.112498 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0628b7-a537-46d3-abb8-f8a56ae8a5b1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:32.117689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd774b573643947ed99aa523db604b985', 'request_id': 'req-963e371f-3609-44da-9b0e-99c2ea9fb2f2'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.166944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:32.167811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.168664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.168944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] PATH_INFO: `/v3/users/6e3d01958d7647bc86f2d555c4e1a6dd` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.170139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3d01958d7647bc86f2d555c4e1a6dd)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:32.172070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:32.279140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] The token cache is being invalidate because project d774b573643947ed99aa523db604b985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:32.279346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.279960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.281528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1003/2016] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:31 2021] DELETE /identity/v3/projects/d774b573643947ed99aa523db604b985 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:32.285311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:32.286583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:32.299292 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e371f-3609-44da-9b0e-99c2ea9fb2f2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:32.303955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:32.304835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.305121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.305403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] PATH_INFO: `/v3/users/3ae14c6c76df42ea9881ae835b7fa88d` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.306713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae14c6c76df42ea9881ae835b7fa88d)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:32.308643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:32.359828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3d01958d7647bc86f2d555c4e1a6dd'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.360772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3d01958d7647bc86f2d555c4e1a6dd'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.361580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3d01958d7647bc86f2d555c4e1a6dd'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.375991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3d01958d7647bc86f2d555c4e1a6dd'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.450341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d3f965d1-8f72-42cf-96b4-53f73fed6c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3d01958d7647bc86f2d555c4e1a6dd'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.463555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1014/2017] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:32 2021] DELETE /identity/v3/users/6e3d01958d7647bc86f2d555c4e1a6dd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:32.465529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb787d-7296-4f16-9598-a8fb8767b610 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.465715 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb787d-7296-4f16-9598-a8fb8767b610 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.465996 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb787d-7296-4f16-9598-a8fb8767b610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.483706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-01eb787d-7296-4f16-9598-a8fb8767b610 None None] MFA Rules not processed for user `2393ef84bc4144d5a44300cd98c55f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:32.484972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-01eb787d-7296-4f16-9598-a8fb8767b610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:32.529934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae14c6c76df42ea9881ae835b7fa88d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.545214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae14c6c76df42ea9881ae835b7fa88d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.546028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae14c6c76df42ea9881ae835b7fa88d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.554117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae14c6c76df42ea9881ae835b7fa88d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.560394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1015/2018] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:32 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:32.640319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae14c6c76df42ea9881ae835b7fa88d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:32.653527 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1004/2019] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:32 2021] DELETE /identity/v3/users/3ae14c6c76df42ea9881ae835b7fa88d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:32.835097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb787d-7296-4f16-9598-a8fb8767b610 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:32.838998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-01eb787d-7296-4f16-9598-a8fb8767b610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:32.957676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb787d-7296-4f16-9598-a8fb8767b610 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:33.057913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:33.059335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.059806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.059940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] PATH_INFO: `/v3/projects/6ca6f1d385e747fda6bcfb72620f85f3` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.062986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca6f1d385e747fda6bcfb72620f85f3)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:33.065378 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:33.184600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca6f1d385e747fda6bcfb72620f85f3', 'request_id': 'req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:33.249193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca6f1d385e747fda6bcfb72620f85f3', 'request_id': 'req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:33.259193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca6f1d385e747fda6bcfb72620f85f3', 'request_id': 'req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:33.259334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:33.259334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:33.269963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] The token cache is being invalidate because project 6ca6f1d385e747fda6bcfb72620f85f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:33.270570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:33.271429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c0f27577-ef28-43fe-a683-0a1f7ed0c5ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:33.273505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1016/2020] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:32 2021] DELETE /identity/v3/projects/6ca6f1d385e747fda6bcfb72620f85f3 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:33.280320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21843a30-cce4-467b-ba69-73594cceaaf1 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.280870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21843a30-cce4-467b-ba69-73594cceaaf1 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.281692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21843a30-cce4-467b-ba69-73594cceaaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.292016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fad515-fc21-45e7-83d3-1712bd9f89b4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:33.310914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-21843a30-cce4-467b-ba69-73594cceaaf1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:33.311663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-21843a30-cce4-467b-ba69-73594cceaaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:33.383638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:33.385117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.385618 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.386102 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] PATH_INFO: `/v3/projects/41af205ca4c54d6b8e96f73ec7c95427` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.388951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41af205ca4c54d6b8e96f73ec7c95427)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:33.391366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:33.416916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1017/2021] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:33.424872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ecdf4-6299-4323-95e2-1e448f7780dc None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.425409 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ecdf4-6299-4323-95e2-1e448f7780dc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.425837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ecdf4-6299-4323-95e2-1e448f7780dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.470576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-511ecdf4-6299-4323-95e2-1e448f7780dc None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:33.471198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-511ecdf4-6299-4323-95e2-1e448f7780dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:33.495566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1018/2022] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:33.500546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ecdf4-6299-4323-95e2-1e448f7780dc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:33.535907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ecdf4-6299-4323-95e2-1e448f7780dc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:33.546347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ef835-5bed-42dc-a4a3-846bc63f633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:33.547214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef835-5bed-42dc-a4a3-846bc63f633c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.547508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef835-5bed-42dc-a4a3-846bc63f633c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.547787 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef835-5bed-42dc-a4a3-846bc63f633c admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.548697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ef835-5bed-42dc-a4a3-846bc63f633c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:33.549011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ef835-5bed-42dc-a4a3-846bc63f633c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:33.550651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ef835-5bed-42dc-a4a3-846bc63f633c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:33.564490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1019/2023] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:33.568637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ef835-5bed-42dc-a4a3-846bc63f633c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:33.576494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41af205ca4c54d6b8e96f73ec7c95427', 'request_id': 'req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:33.587245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41af205ca4c54d6b8e96f73ec7c95427', 'request_id': 'req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:33.590542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ef835-5bed-42dc-a4a3-846bc63f633c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:33.598036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41af205ca4c54d6b8e96f73ec7c95427', 'request_id': 'req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:33.670394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683facbf-8562-455d-a6c6-bf3847475fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:33.671118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683facbf-8562-455d-a6c6-bf3847475fbb admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.671407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683facbf-8562-455d-a6c6-bf3847475fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.671686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683facbf-8562-455d-a6c6-bf3847475fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.672406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683facbf-8562-455d-a6c6-bf3847475fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:33.674387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683facbf-8562-455d-a6c6-bf3847475fbb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:33.773359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] The token cache is being invalidate because project 41af205ca4c54d6b8e96f73ec7c95427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:33.773793 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:33.774859 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c1ef86a6-f68c-43b6-a86e-f5c97fcd7063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:33.777419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1005/2024] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:33 2021] DELETE /identity/v3/projects/41af205ca4c54d6b8e96f73ec7c95427 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:33.783534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd2d5-5bf7-4dc2-a024-ad72b4033845 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.783898 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd2d5-5bf7-4dc2-a024-ad72b4033845 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.784270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd2d5-5bf7-4dc2-a024-ad72b4033845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.803277 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-950bd2d5-5bf7-4dc2-a024-ad72b4033845 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:33.804499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-950bd2d5-5bf7-4dc2-a024-ad72b4033845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:33.813345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1006/2025] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:33.829875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec5050-7ef5-493f-9531-e99b5f887d9d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.829875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec5050-7ef5-493f-9531-e99b5f887d9d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.829875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec5050-7ef5-493f-9531-e99b5f887d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.830201 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1020/2026] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:33 2021] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:33.830920 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683facbf-8562-455d-a6c6-bf3847475fbb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:33.833126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-683facbf-8562-455d-a6c6-bf3847475fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:33.848831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f9ec5050-7ef5-493f-9531-e99b5f887d9d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:33.850097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f9ec5050-7ef5-493f-9531-e99b5f887d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:33.916685 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1007/2027] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:33.920733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec5050-7ef5-493f-9531-e99b5f887d9d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:33.921625 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683facbf-8562-455d-a6c6-bf3847475fbb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:33.928392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa6d6e-247d-4f1d-a5c2-1403aa69418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:33.929077 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa6d6e-247d-4f1d-a5c2-1403aa69418a admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.929354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa6d6e-247d-4f1d-a5c2-1403aa69418a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.934683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa6d6e-247d-4f1d-a5c2-1403aa69418a admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.934683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa6d6e-247d-4f1d-a5c2-1403aa69418a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:33.934870 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec5050-7ef5-493f-9531-e99b5f887d9d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:33.934979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa6d6e-247d-4f1d-a5c2-1403aa69418a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:33.936756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31257c99-2048-435c-adde-d7140664c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:33.937505 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257c99-2048-435c-adde-d7140664c93a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.937717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257c99-2048-435c-adde-d7140664c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.937980 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257c99-2048-435c-adde-d7140664c93a admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.939135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31257c99-2048-435c-adde-d7140664c93a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:33.939135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31257c99-2048-435c-adde-d7140664c93a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:33.940849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31257c99-2048-435c-adde-d7140664c93a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:33.956655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1008/2028] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:45:33.958977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31257c99-2048-435c-adde-d7140664c93a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:33.970950 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31257c99-2048-435c-adde-d7140664c93a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:33.978133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e18ccd-9232-43d9-86ec-97adaeb760bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:33.978133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e18ccd-9232-43d9-86ec-97adaeb760bf admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.978133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e18ccd-9232-43d9-86ec-97adaeb760bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.978482 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e18ccd-9232-43d9-86ec-97adaeb760bf admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.978871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e18ccd-9232-43d9-86ec-97adaeb760bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:33.981526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e18ccd-9232-43d9-86ec-97adaeb760bf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:34.015670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1021/2029] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:33 2021] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:34.021810 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa6d6e-247d-4f1d-a5c2-1403aa69418a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:34.035752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa6d6e-247d-4f1d-a5c2-1403aa69418a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:34.041326 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7a3e0-dfb0-4db5-b484-41d9352e0232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:34.042151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7a3e0-dfb0-4db5-b484-41d9352e0232 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:34.042435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7a3e0-dfb0-4db5-b484-41d9352e0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:34.042749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7a3e0-dfb0-4db5-b484-41d9352e0232 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:34.043549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7a3e0-dfb0-4db5-b484-41d9352e0232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:34.045283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7a3e0-dfb0-4db5-b484-41d9352e0232 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:34.055891 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1022/2030] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:34 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:34.060416 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7a3e0-dfb0-4db5-b484-41d9352e0232 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:34.070663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7a3e0-dfb0-4db5-b484-41d9352e0232 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:34.079071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2427e-7305-42ba-8f4b-b0ba403d9ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:34.087419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2427e-7305-42ba-8f4b-b0ba403d9ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:34.087419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2427e-7305-42ba-8f4b-b0ba403d9ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:34.087419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2427e-7305-42ba-8f4b-b0ba403d9ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:34.087419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2427e-7305-42ba-8f4b-b0ba403d9ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:34.087419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2427e-7305-42ba-8f4b-b0ba403d9ea6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:34.093568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1023/2031] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:34 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:34.097962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2427e-7305-42ba-8f4b-b0ba403d9ea6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:34.108150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2427e-7305-42ba-8f4b-b0ba403d9ea6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:34.115446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1009/2032] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:33 2021] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:34.115610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5adc15-5f39-4550-ae1c-3134cee34676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:34.115610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5adc15-5f39-4550-ae1c-3134cee34676 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:34.115610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5adc15-5f39-4550-ae1c-3134cee34676 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:34.115610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5adc15-5f39-4550-ae1c-3134cee34676 admin admin] PATH_INFO: `/v3/projects/89a52f35522b47d7a180343148a48705/users/a19d642aa2524233a93d7463feafb555/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:34.116811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e18ccd-9232-43d9-86ec-97adaeb760bf admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:34.133145 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5adc15-5f39-4550-ae1c-3134cee34676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a52f35522b47d7a180343148a48705, user_id=a19d642aa2524233a93d7463feafb555, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:34.137615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5adc15-5f39-4550-ae1c-3134cee34676 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:34.182575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e18ccd-9232-43d9-86ec-97adaeb760bf admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:34.189266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2e579-f673-4f92-958b-3c99e39d2e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:34.189964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2e579-f673-4f92-958b-3c99e39d2e28 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:34.190264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2e579-f673-4f92-958b-3c99e39d2e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:34.190627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2e579-f673-4f92-958b-3c99e39d2e28 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:34.191482 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2e579-f673-4f92-958b-3c99e39d2e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:34.193478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2e579-f673-4f92-958b-3c99e39d2e28 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:34.277461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1024/2033] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:34 2021] PUT /identity/v3/projects/89a52f35522b47d7a180343148a48705/users/a19d642aa2524233a93d7463feafb555/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:34.322942 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c7fa4-e26c-4bed-99f8-29f5428b20f7 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:34.323165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c7fa4-e26c-4bed-99f8-29f5428b20f7 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:34.323446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c7fa4-e26c-4bed-99f8-29f5428b20f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:34.350016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-431c7fa4-e26c-4bed-99f8-29f5428b20f7 None None] MFA Rules not processed for user `a19d642aa2524233a93d7463feafb555`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:34.351376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-431c7fa4-e26c-4bed-99f8-29f5428b20f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:34.353554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1010/2034] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:34 2021] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:34.358704 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2e579-f673-4f92-958b-3c99e39d2e28 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:34.385858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2e579-f673-4f92-958b-3c99e39d2e28 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:34.438944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1025/2035] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:34 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:34.453357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a7e9a-1f96-4fd4-8950-5bbd8a1de897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:34.454043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a7e9a-1f96-4fd4-8950-5bbd8a1de897 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:34.455492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c7fa4-e26c-4bed-99f8-29f5428b20f7 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:34.457049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-431c7fa4-e26c-4bed-99f8-29f5428b20f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:34.460667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a7e9a-1f96-4fd4-8950-5bbd8a1de897 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:34.460909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a7e9a-1f96-4fd4-8950-5bbd8a1de897 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:34.461782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a7e9a-1f96-4fd4-8950-5bbd8a1de897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:34.463677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a7e9a-1f96-4fd4-8950-5bbd8a1de897 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:34.475686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1011/2036] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:34 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:34.479461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a7e9a-1f96-4fd4-8950-5bbd8a1de897 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:34.489628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a7e9a-1f96-4fd4-8950-5bbd8a1de897 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:34.494771 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdd060-cf6c-4495-8f72-342f1134939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:34.495582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdd060-cf6c-4495-8f72-342f1134939d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:34.495755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdd060-cf6c-4495-8f72-342f1134939d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:34.496776 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdd060-cf6c-4495-8f72-342f1134939d admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:34.497662 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdd060-cf6c-4495-8f72-342f1134939d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:34.499325 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdd060-cf6c-4495-8f72-342f1134939d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:34.510786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1012/2037] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:34.514320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdd060-cf6c-4495-8f72-342f1134939d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:34.525092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdd060-cf6c-4495-8f72-342f1134939d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:34.531415 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f4c2-8cc7-4953-a807-8dca0bc374ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:34.532305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f4c2-8cc7-4953-a807-8dca0bc374ed admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:34.532623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f4c2-8cc7-4953-a807-8dca0bc374ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:34.532904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f4c2-8cc7-4953-a807-8dca0bc374ed admin admin] PATH_INFO: `/v3/projects/48f1416c71c6480a98db0bc3beff898b/users/9f55b5a401884576af6c8b863aab4636/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:34.534544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c7fa4-e26c-4bed-99f8-29f5428b20f7 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:34.544434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ac9b7-374b-40f0-b9d4-67678d0d3fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:34.544434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ac9b7-374b-40f0-b9d4-67678d0d3fa4 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:34.544434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ac9b7-374b-40f0-b9d4-67678d0d3fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:34.544434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ac9b7-374b-40f0-b9d4-67678d0d3fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:34.547671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66f4c2-8cc7-4953-a807-8dca0bc374ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f1416c71c6480a98db0bc3beff898b, user_id=9f55b5a401884576af6c8b863aab4636, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:34.549650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ac9b7-374b-40f0-b9d4-67678d0d3fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:34.550404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66f4c2-8cc7-4953-a807-8dca0bc374ed admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:34.551232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ac9b7-374b-40f0-b9d4-67678d0d3fa4 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:34.560646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1026/2038] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:34 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:34.755577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1013/2039] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:34 2021] PUT /identity/v3/projects/48f1416c71c6480a98db0bc3beff898b/users/9f55b5a401884576af6c8b863aab4636/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:34.768006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebaf60-a496-4751-bb3f-cb993f237bed None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:34.768321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebaf60-a496-4751-bb3f-cb993f237bed None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:34.768628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebaf60-a496-4751-bb3f-cb993f237bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:34.799482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-6eebaf60-a496-4751-bb3f-cb993f237bed None None] MFA Rules not processed for user `9f55b5a401884576af6c8b863aab4636`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:34.800767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6eebaf60-a496-4751-bb3f-cb993f237bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:34.875557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1027/2040] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:34 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:35.001427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f4c2-8cc7-4953-a807-8dca0bc374ed admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:35.003233 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0b66f4c2-8cc7-4953-a807-8dca0bc374ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:35.062089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f4c2-8cc7-4953-a807-8dca0bc374ed admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:35.065911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bb995-36ea-4755-a5b3-857796d84b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:35.066651 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bb995-36ea-4755-a5b3-857796d84b63 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:35.066937 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bb995-36ea-4755-a5b3-857796d84b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:35.067249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bb995-36ea-4755-a5b3-857796d84b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:35.078165 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bb995-36ea-4755-a5b3-857796d84b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:35.079655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bb995-36ea-4755-a5b3-857796d84b63 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:35.089412 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1014/2041] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:35 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:35.936668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473a886-a90d-4209-a95f-c6b39e60e572 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:35.937577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473a886-a90d-4209-a95f-c6b39e60e572 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:35.938283 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473a886-a90d-4209-a95f-c6b39e60e572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:35.957252 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c473a886-a90d-4209-a95f-c6b39e60e572 None None] MFA Rules not processed for user `b5b99e0829e84f2bb0a58e835a1cdc47`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:35.958645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c473a886-a90d-4209-a95f-c6b39e60e572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:36.023370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1028/2042] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:35 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:41.601960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bb995-36ea-4755-a5b3-857796d84b63 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:41.623371 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473a886-a90d-4209-a95f-c6b39e60e572 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:41.695052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bb995-36ea-4755-a5b3-857796d84b63 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:41.704178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:41.705646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:41.706517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:41.707698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] PATH_INFO: `/v3/users/a19d642aa2524233a93d7463feafb555` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:41.709640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19d642aa2524233a93d7463feafb555)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:41.712590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:41.736626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473a886-a90d-4209-a95f-c6b39e60e572 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:41.749967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:41.751126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:41.751414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:41.751694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] PATH_INFO: `/v3/users/9f55b5a401884576af6c8b863aab4636` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:41.759617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f55b5a401884576af6c8b863aab4636)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:41.762157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:41.908658 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19d642aa2524233a93d7463feafb555'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:41.934831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19d642aa2524233a93d7463feafb555'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:41.938047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19d642aa2524233a93d7463feafb555'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:41.940978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f55b5a401884576af6c8b863aab4636'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:41.941930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f55b5a401884576af6c8b863aab4636'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:41.942560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f55b5a401884576af6c8b863aab4636'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:41.949867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19d642aa2524233a93d7463feafb555'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:41.956445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f55b5a401884576af6c8b863aab4636'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:42.039288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-337fff57-56df-4daf-acef-f82a5ec85990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19d642aa2524233a93d7463feafb555'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:42.046355 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1015/2043] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:41 2021] DELETE /identity/v3/users/a19d642aa2524233a93d7463feafb555 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:42.051387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8ec30-479f-41c4-bb2b-fe0b9e8acdea None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:42.051991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8ec30-479f-41c4-bb2b-fe0b9e8acdea None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:42.052575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8ec30-479f-41c4-bb2b-fe0b9e8acdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:42.072137 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e9c8ec30-479f-41c4-bb2b-fe0b9e8acdea None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:42.074137 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e9c8ec30-479f-41c4-bb2b-fe0b9e8acdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:42.124839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-e2afbed5-91cd-4ae6-afbd-1b6e26319065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f55b5a401884576af6c8b863aab4636'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:42.143630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1029/2044] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:41 2021] DELETE /identity/v3/users/9f55b5a401884576af6c8b863aab4636 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:42.145350 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdce72-7548-4841-8104-4d914b066a4f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:42.145813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdce72-7548-4841-8104-4d914b066a4f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:42.146241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdce72-7548-4841-8104-4d914b066a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:42.173297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-30cdce72-7548-4841-8104-4d914b066a4f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:42.174591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-30cdce72-7548-4841-8104-4d914b066a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:42.177418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1016/2045] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:42.207493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8ec30-479f-41c4-bb2b-fe0b9e8acdea None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:42.209639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e9c8ec30-479f-41c4-bb2b-fe0b9e8acdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:42.254015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1030/2046] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:42.265404 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdce72-7548-4841-8104-4d914b066a4f None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:42.266967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-30cdce72-7548-4841-8104-4d914b066a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:42.295067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8ec30-479f-41c4-bb2b-fe0b9e8acdea None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:42.329398 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdce72-7548-4841-8104-4d914b066a4f None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:42.337129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e704eb-2a5f-44ca-90ca-95b7b8148671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:42.337837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e704eb-2a5f-44ca-90ca-95b7b8148671 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:42.338060 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e704eb-2a5f-44ca-90ca-95b7b8148671 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:42.338336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e704eb-2a5f-44ca-90ca-95b7b8148671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:42.349545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e704eb-2a5f-44ca-90ca-95b7b8148671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:42.356413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e704eb-2a5f-44ca-90ca-95b7b8148671 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:42.357628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a21848-cbca-45d1-a015-a8ba952f19b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:42.358394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a21848-cbca-45d1-a015-a8ba952f19b9 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:42.358736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a21848-cbca-45d1-a015-a8ba952f19b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:42.359076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a21848-cbca-45d1-a015-a8ba952f19b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:42.371319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a21848-cbca-45d1-a015-a8ba952f19b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:42.373341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a21848-cbca-45d1-a015-a8ba952f19b9 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:42.374374 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1031/2047] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:42.391117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1017/2048] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:42.916700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492dc26-8b93-4561-adf9-abfcafab1168 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:42.916700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492dc26-8b93-4561-adf9-abfcafab1168 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:42.916700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492dc26-8b93-4561-adf9-abfcafab1168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:42.939944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-8492dc26-8b93-4561-adf9-abfcafab1168 None None] MFA Rules not processed for user `e87c6b2f12d04a6d8929e960e6268761`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:42.941565 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8492dc26-8b93-4561-adf9-abfcafab1168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:43.000979 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a21848-cbca-45d1-a015-a8ba952f19b9 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:43.002959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c1a21848-cbca-45d1-a015-a8ba952f19b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:43.029094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a21848-cbca-45d1-a015-a8ba952f19b9 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:43.035010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1032/2049] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:42 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:43.041156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:43.049472 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.049917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.050358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] PATH_INFO: `/v3/projects/48f1416c71c6480a98db0bc3beff898b` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.051842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f1416c71c6480a98db0bc3beff898b)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:43.054188 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:43.177603 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f1416c71c6480a98db0bc3beff898b', 'request_id': 'req-6840bed2-5b6e-425c-82ba-e336a3e13b0d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:43.184859 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f1416c71c6480a98db0bc3beff898b', 'request_id': 'req-6840bed2-5b6e-425c-82ba-e336a3e13b0d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:43.192944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f1416c71c6480a98db0bc3beff898b', 'request_id': 'req-6840bed2-5b6e-425c-82ba-e336a3e13b0d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:43.313619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] The token cache is being invalidate because project 48f1416c71c6480a98db0bc3beff898b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:43.313949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:43.314598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:43.316172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1018/2050] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:42 2021] DELETE /identity/v3/projects/48f1416c71c6480a98db0bc3beff898b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:43.322050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e1fab-24fc-41a2-8320-d8bd4f80345f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.322426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e1fab-24fc-41a2-8320-d8bd4f80345f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.322706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e1fab-24fc-41a2-8320-d8bd4f80345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.340451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b05e1fab-24fc-41a2-8320-d8bd4f80345f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:43.341656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b05e1fab-24fc-41a2-8320-d8bd4f80345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:43.371673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:43.373197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:43.414911 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1033/2051] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:43.425467 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f338a0-ad24-4358-8ccc-10ba323c5af2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.427336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f338a0-ad24-4358-8ccc-10ba323c5af2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.427336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f338a0-ad24-4358-8ccc-10ba323c5af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.447298 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-73f338a0-ad24-4358-8ccc-10ba323c5af2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:43.448804 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-73f338a0-ad24-4358-8ccc-10ba323c5af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:43.460199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1034/2052] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:43.462991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f338a0-ad24-4358-8ccc-10ba323c5af2 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:43.468441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840bed2-5b6e-425c-82ba-e336a3e13b0d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:43.473822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f338a0-ad24-4358-8ccc-10ba323c5af2 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:43.473997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:43.474700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.474987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.475265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] PATH_INFO: `/v3/projects/89a52f35522b47d7a180343148a48705` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.476518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a52f35522b47d7a180343148a48705)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:43.478441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:43.479972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0efd7-aa2b-46df-aead-7dd1157e788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:43.481368 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0efd7-aa2b-46df-aead-7dd1157e788c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.481815 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0efd7-aa2b-46df-aead-7dd1157e788c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.482102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0efd7-aa2b-46df-aead-7dd1157e788c admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.482835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0efd7-aa2b-46df-aead-7dd1157e788c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:43.483149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0efd7-aa2b-46df-aead-7dd1157e788c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:43.484798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0efd7-aa2b-46df-aead-7dd1157e788c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:43.502950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1035/2053] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:43.504306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0efd7-aa2b-46df-aead-7dd1157e788c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:43.514913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0efd7-aa2b-46df-aead-7dd1157e788c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:43.519830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118243c-3d40-48b5-bb2d-ed5df1335835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:43.520527 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118243c-3d40-48b5-bb2d-ed5df1335835 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.520817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118243c-3d40-48b5-bb2d-ed5df1335835 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.521096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118243c-3d40-48b5-bb2d-ed5df1335835 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.523323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118243c-3d40-48b5-bb2d-ed5df1335835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:43.523753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118243c-3d40-48b5-bb2d-ed5df1335835 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:43.587449 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a52f35522b47d7a180343148a48705', 'request_id': 'req-44578d11-53a7-4924-8844-a7ec3e9f1000'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:43.594522 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a52f35522b47d7a180343148a48705', 'request_id': 'req-44578d11-53a7-4924-8844-a7ec3e9f1000'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:43.599933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a52f35522b47d7a180343148a48705', 'request_id': 'req-44578d11-53a7-4924-8844-a7ec3e9f1000'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:43.626916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1036/2054] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:43 2021] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:43.627303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118243c-3d40-48b5-bb2d-ed5df1335835 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:43.678666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] The token cache is being invalidate because project 89a52f35522b47d7a180343148a48705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:43.678982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:43.679648 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-44578d11-53a7-4924-8844-a7ec3e9f1000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:43.685402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1019/2055] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:43 2021] DELETE /identity/v3/projects/89a52f35522b47d7a180343148a48705 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:43.687372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7b65d-dba5-4479-a407-d3d56bb644f0 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.687673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7b65d-dba5-4479-a407-d3d56bb644f0 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.687953 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7b65d-dba5-4479-a407-d3d56bb644f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.707499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e6d7b65d-dba5-4479-a407-d3d56bb644f0 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:43.708765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e6d7b65d-dba5-4479-a407-d3d56bb644f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:43.718047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1020/2056] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:43.725789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118243c-3d40-48b5-bb2d-ed5df1335835 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:43.725789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdd407-0fca-457a-9df9-32e71fd2716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:43.726501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd407-0fca-457a-9df9-32e71fd2716f admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.726501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd407-0fca-457a-9df9-32e71fd2716f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.726819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd407-0fca-457a-9df9-32e71fd2716f admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.727526 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdd407-0fca-457a-9df9-32e71fd2716f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:43.729876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdd407-0fca-457a-9df9-32e71fd2716f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:43.736951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025adf-b358-49a7-980b-d7245e10640b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.737363 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025adf-b358-49a7-980b-d7245e10640b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.737753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025adf-b358-49a7-980b-d7245e10640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.765196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b4025adf-b358-49a7-980b-d7245e10640b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:43.766433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b4025adf-b358-49a7-980b-d7245e10640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:43.779625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1021/2057] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:43.780637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025adf-b358-49a7-980b-d7245e10640b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:43.791127 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025adf-b358-49a7-980b-d7245e10640b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:43.797665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ad280-08f0-4fff-ba78-d498e882c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:43.798341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ad280-08f0-4fff-ba78-d498e882c4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.798627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ad280-08f0-4fff-ba78-d498e882c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.798903 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ad280-08f0-4fff-ba78-d498e882c4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.799957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ad280-08f0-4fff-ba78-d498e882c4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:43.800285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ad280-08f0-4fff-ba78-d498e882c4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:43.802001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ad280-08f0-4fff-ba78-d498e882c4d6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:43.826991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1022/2058] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:43.828036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ad280-08f0-4fff-ba78-d498e882c4d6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:43.837508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1037/2059] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:43 2021] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:43.842049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdd407-0fca-457a-9df9-32e71fd2716f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:43.843679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ad280-08f0-4fff-ba78-d498e882c4d6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:43.844435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b1bdd407-0fca-457a-9df9-32e71fd2716f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:43.850115 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff764348-e03a-4201-851c-07185d79bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:43.851282 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff764348-e03a-4201-851c-07185d79bc1d admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.851566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff764348-e03a-4201-851c-07185d79bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.851890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff764348-e03a-4201-851c-07185d79bc1d admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.852686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff764348-e03a-4201-851c-07185d79bc1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:43.855153 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff764348-e03a-4201-851c-07185d79bc1d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:43.865979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdd407-0fca-457a-9df9-32e71fd2716f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:43.873464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36800238-903b-402c-8774-2e17b036ee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:43.874416 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36800238-903b-402c-8774-2e17b036ee71 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.875063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36800238-903b-402c-8774-2e17b036ee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.875550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36800238-903b-402c-8774-2e17b036ee71 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.877149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36800238-903b-402c-8774-2e17b036ee71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:43.879033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36800238-903b-402c-8774-2e17b036ee71 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:43.914104 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1038/2060] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:43 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:43.920197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36800238-903b-402c-8774-2e17b036ee71 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:43.947197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36800238-903b-402c-8774-2e17b036ee71 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:43.975126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda6f5-6eb0-482f-9cdd-1a3c7d53e283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:43.975718 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda6f5-6eb0-482f-9cdd-1a3c7d53e283 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:43.976006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda6f5-6eb0-482f-9cdd-1a3c7d53e283 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:43.976288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda6f5-6eb0-482f-9cdd-1a3c7d53e283 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:43.977072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bda6f5-6eb0-482f-9cdd-1a3c7d53e283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:43.978558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1023/2061] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:43 2021] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:43.979658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bda6f5-6eb0-482f-9cdd-1a3c7d53e283 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:43.982493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff764348-e03a-4201-851c-07185d79bc1d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:44.014306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1039/2062] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:43 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:44.018887 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda6f5-6eb0-482f-9cdd-1a3c7d53e283 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:44.038791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda6f5-6eb0-482f-9cdd-1a3c7d53e283 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:44.081453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff764348-e03a-4201-851c-07185d79bc1d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:44.094463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5be484-162d-4256-95d9-abe64cd627ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:44.095387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5be484-162d-4256-95d9-abe64cd627ad admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:44.095833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5be484-162d-4256-95d9-abe64cd627ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:44.096304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5be484-162d-4256-95d9-abe64cd627ad admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:44.097884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5be484-162d-4256-95d9-abe64cd627ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:44.102213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5be484-162d-4256-95d9-abe64cd627ad admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:44.169390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ea2c9-5578-483f-8d84-da208925babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:44.170782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea2c9-5578-483f-8d84-da208925babe admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:44.171334 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea2c9-5578-483f-8d84-da208925babe admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:44.172001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea2c9-5578-483f-8d84-da208925babe admin admin] PATH_INFO: `/v3/projects/92b52bac76904561ad7afe6ed672e999/users/541c688efdf8455c9a083ca11f2678be/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:44.190342 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ea2c9-5578-483f-8d84-da208925babe admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b52bac76904561ad7afe6ed672e999, user_id=541c688efdf8455c9a083ca11f2678be, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:44.193561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ea2c9-5578-483f-8d84-da208925babe admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:44.242057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1024/2063] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:43 2021] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:44.249324 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5be484-162d-4256-95d9-abe64cd627ad admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:44.264916 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5be484-162d-4256-95d9-abe64cd627ad admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:44.270677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55335b32-77e2-4b13-b79a-1e950fd5f357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:44.271399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55335b32-77e2-4b13-b79a-1e950fd5f357 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:44.272298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55335b32-77e2-4b13-b79a-1e950fd5f357 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:44.272577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55335b32-77e2-4b13-b79a-1e950fd5f357 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:44.275827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55335b32-77e2-4b13-b79a-1e950fd5f357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:44.275827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55335b32-77e2-4b13-b79a-1e950fd5f357 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:44.291433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1025/2064] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:44 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:44.292620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55335b32-77e2-4b13-b79a-1e950fd5f357 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:44.307279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1040/2065] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:44 2021] PUT /identity/v3/projects/92b52bac76904561ad7afe6ed672e999/users/541c688efdf8455c9a083ca11f2678be/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:44.313891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55335b32-77e2-4b13-b79a-1e950fd5f357 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:44.315202 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ea1e8-3d67-4db5-b420-cf5116e5a3e4 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:44.316455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ea1e8-3d67-4db5-b420-cf5116e5a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:44.317180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ea1e8-3d67-4db5-b420-cf5116e5a3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:44.367132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-1b6ea1e8-3d67-4db5-b420-cf5116e5a3e4 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:44.368757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1b6ea1e8-3d67-4db5-b420-cf5116e5a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:44.428555 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f0bb3-df49-4251-919a-b41ead29ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:44.434725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0bb3-df49-4251-919a-b41ead29ccd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:44.434725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0bb3-df49-4251-919a-b41ead29ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:44.434725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0bb3-df49-4251-919a-b41ead29ccd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:44.434725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f0bb3-df49-4251-919a-b41ead29ccd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:44.441902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f0bb3-df49-4251-919a-b41ead29ccd6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:44.472321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1026/2066] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:44 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:44.473576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f0bb3-df49-4251-919a-b41ead29ccd6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:44.490435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f0bb3-df49-4251-919a-b41ead29ccd6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:44.501677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a72d8-2d5d-40d5-bb07-d5f448f150cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:44.502995 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a72d8-2d5d-40d5-bb07-d5f448f150cf admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:44.503309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a72d8-2d5d-40d5-bb07-d5f448f150cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:44.503587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a72d8-2d5d-40d5-bb07-d5f448f150cf admin admin] PATH_INFO: `/v3/projects/48aa1377de2045e38830bc5e04633dbc/users/156a1a6c892e4de7bd390c6da89047db/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:44.508427 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1041/2067] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:44.519281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ea1e8-3d67-4db5-b420-cf5116e5a3e4 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:44.521888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1b6ea1e8-3d67-4db5-b420-cf5116e5a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:44.523303 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a72d8-2d5d-40d5-bb07-d5f448f150cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=48aa1377de2045e38830bc5e04633dbc, user_id=156a1a6c892e4de7bd390c6da89047db, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:44.527612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a72d8-2d5d-40d5-bb07-d5f448f150cf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:44.584331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ea1e8-3d67-4db5-b420-cf5116e5a3e4 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:44.588010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2042cb-4ed2-428e-b375-7637322f509c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:44.588677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2042cb-4ed2-428e-b375-7637322f509c service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:44.588956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2042cb-4ed2-428e-b375-7637322f509c service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:44.589240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2042cb-4ed2-428e-b375-7637322f509c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:44.598211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2042cb-4ed2-428e-b375-7637322f509c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:44.599755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2042cb-4ed2-428e-b375-7637322f509c service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:44.609988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1042/2068] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:44.661512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1027/2069] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:44 2021] PUT /identity/v3/projects/48aa1377de2045e38830bc5e04633dbc/users/156a1a6c892e4de7bd390c6da89047db/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:44.673743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624f15-1dc0-4956-a9c7-971500864803 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:44.674037 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624f15-1dc0-4956-a9c7-971500864803 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:44.674419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624f15-1dc0-4956-a9c7-971500864803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:44.708612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-8b624f15-1dc0-4956-a9c7-971500864803 None None] MFA Rules not processed for user `156a1a6c892e4de7bd390c6da89047db`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:44.710095 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8b624f15-1dc0-4956-a9c7-971500864803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:44.950962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1043/2070] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:44 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:44.955276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a72d8-2d5d-40d5-bb07-d5f448f150cf admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:45.023906 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a72d8-2d5d-40d5-bb07-d5f448f150cf admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:45.029255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e52204-c69d-4b7a-9a8b-df5f71e041df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:45.030595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e52204-c69d-4b7a-9a8b-df5f71e041df admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:45.030595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e52204-c69d-4b7a-9a8b-df5f71e041df admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:45.030965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e52204-c69d-4b7a-9a8b-df5f71e041df admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:45.031760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e52204-c69d-4b7a-9a8b-df5f71e041df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:45.034083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e52204-c69d-4b7a-9a8b-df5f71e041df admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:45.107763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624f15-1dc0-4956-a9c7-971500864803 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:45.109228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8b624f15-1dc0-4956-a9c7-971500864803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:45.125069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624f15-1dc0-4956-a9c7-971500864803 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:45.130109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:45.131035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:45.131340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:45.131617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] PATH_INFO: `/v3/users/25d4c30c0cd04b9f824fc85be280f200` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:45.132957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d4c30c0cd04b9f824fc85be280f200)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:45.134884 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:45.201350 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1028/2071] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:44 2021] POST /identity/v3/projects => generated 365 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:45.202339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e52204-c69d-4b7a-9a8b-df5f71e041df admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:45.300669 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e52204-c69d-4b7a-9a8b-df5f71e041df admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:45.305707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16301a2-2a60-4045-89ee-de61e51bea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:45.306670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16301a2-2a60-4045-89ee-de61e51bea92 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:45.307308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16301a2-2a60-4045-89ee-de61e51bea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:45.307997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16301a2-2a60-4045-89ee-de61e51bea92 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:45.308955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16301a2-2a60-4045-89ee-de61e51bea92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:45.313311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16301a2-2a60-4045-89ee-de61e51bea92 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:45.414116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d4c30c0cd04b9f824fc85be280f200'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:45.414963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d4c30c0cd04b9f824fc85be280f200'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:45.415479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d4c30c0cd04b9f824fc85be280f200'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:45.429149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d4c30c0cd04b9f824fc85be280f200'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:45.496010 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1029/2072] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:45 2021] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:45.502877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16301a2-2a60-4045-89ee-de61e51bea92 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:45.504791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f16301a2-2a60-4045-89ee-de61e51bea92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:45.518875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16301a2-2a60-4045-89ee-de61e51bea92 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:45.525501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1692ab4-1180-4e1d-aa0b-a88fa5d6a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:45.529142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1692ab4-1180-4e1d-aa0b-a88fa5d6a285 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:45.529445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1692ab4-1180-4e1d-aa0b-a88fa5d6a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:45.529728 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1692ab4-1180-4e1d-aa0b-a88fa5d6a285 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:45.530488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1692ab4-1180-4e1d-aa0b-a88fa5d6a285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:45.532107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1692ab4-1180-4e1d-aa0b-a88fa5d6a285 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:45.542819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1030/2073] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:45 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:45.549213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1692ab4-1180-4e1d-aa0b-a88fa5d6a285 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:45.559740 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1692ab4-1180-4e1d-aa0b-a88fa5d6a285 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:45.565419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2676f7b-71d7-426a-b1a2-0d372160243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:45.566302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2676f7b-71d7-426a-b1a2-0d372160243c admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:45.566682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2676f7b-71d7-426a-b1a2-0d372160243c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:45.566878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2676f7b-71d7-426a-b1a2-0d372160243c admin admin] PATH_INFO: `/v3/projects/afafb56098dc46bf891049790931016f/users/8ff2034fb011419093b597385362c3d8/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:45.598306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2676f7b-71d7-426a-b1a2-0d372160243c admin admin] RBAC: Authorizing `identity:create_grant(project_id=afafb56098dc46bf891049790931016f, user_id=8ff2034fb011419093b597385362c3d8, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:45.601245 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2676f7b-71d7-426a-b1a2-0d372160243c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:45.621940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a9dea9ec-3866-4a1b-a868-36e7adb14b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d4c30c0cd04b9f824fc85be280f200'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:45.640393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1044/2074] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:45 2021] DELETE /identity/v3/users/25d4c30c0cd04b9f824fc85be280f200 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:45.650717 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0335239-13ba-4e76-9ce4-4026a8bc7472 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:45.651097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0335239-13ba-4e76-9ce4-4026a8bc7472 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:45.651987 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0335239-13ba-4e76-9ce4-4026a8bc7472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:45.675521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c0335239-13ba-4e76-9ce4-4026a8bc7472 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:45.676949 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c0335239-13ba-4e76-9ce4-4026a8bc7472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:45.743846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1045/2075] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:45.754065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0335239-13ba-4e76-9ce4-4026a8bc7472 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:45.755854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c0335239-13ba-4e76-9ce4-4026a8bc7472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:45.793457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1031/2076] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:45 2021] PUT /identity/v3/projects/afafb56098dc46bf891049790931016f/users/8ff2034fb011419093b597385362c3d8/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:45.794905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2676f7b-71d7-426a-b1a2-0d372160243c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:45.821581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0335239-13ba-4e76-9ce4-4026a8bc7472 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:45.878489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2676f7b-71d7-426a-b1a2-0d372160243c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:45.882885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cb8c7-57e2-4cbe-8fe0-887d579cbbfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:45.883569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cb8c7-57e2-4cbe-8fe0-887d579cbbfd service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:45.883855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cb8c7-57e2-4cbe-8fe0-887d579cbbfd service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:45.884107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157f0d4-f7dd-4075-9c19-26b37b740236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:45.884260 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cb8c7-57e2-4cbe-8fe0-887d579cbbfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:45.884810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f0d4-f7dd-4075-9c19-26b37b740236 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:45.885092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f0d4-f7dd-4075-9c19-26b37b740236 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:45.885369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f0d4-f7dd-4075-9c19-26b37b740236 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:45.886095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157f0d4-f7dd-4075-9c19-26b37b740236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:45.888286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157f0d4-f7dd-4075-9c19-26b37b740236 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:45.895927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cb8c7-57e2-4cbe-8fe0-887d579cbbfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:45.897610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cb8c7-57e2-4cbe-8fe0-887d579cbbfd service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:45.901671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1032/2077] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:45 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:45.903654 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157f0d4-f7dd-4075-9c19-26b37b740236 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:45.908450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1046/2078] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:45.917483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157f0d4-f7dd-4075-9c19-26b37b740236 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:45.920752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657c4f3-ed3f-444e-8476-c8d4d5ddc864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:45.921819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657c4f3-ed3f-444e-8476-c8d4d5ddc864 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:45.922066 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657c4f3-ed3f-444e-8476-c8d4d5ddc864 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:45.927996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657c4f3-ed3f-444e-8476-c8d4d5ddc864 admin admin] PATH_INFO: `/v3/projects/afafb56098dc46bf891049790931016f/users/8ff2034fb011419093b597385362c3d8/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:45.927996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657c4f3-ed3f-444e-8476-c8d4d5ddc864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afafb56098dc46bf891049790931016f, user_id=8ff2034fb011419093b597385362c3d8, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:45.927996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657c4f3-ed3f-444e-8476-c8d4d5ddc864 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:45.939334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1033/2079] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:45 2021] PUT /identity/v3/projects/afafb56098dc46bf891049790931016f/users/8ff2034fb011419093b597385362c3d8/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:45.950282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d78e-ebac-49f1-8a0c-b88750f63ce6 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:45.950567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d78e-ebac-49f1-8a0c-b88750f63ce6 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:45.950843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d78e-ebac-49f1-8a0c-b88750f63ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:45.978561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2162d78e-ebac-49f1-8a0c-b88750f63ce6 None None] MFA Rules not processed for user `8ff2034fb011419093b597385362c3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:45.979560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2162d78e-ebac-49f1-8a0c-b88750f63ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:46.065861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1047/2080] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:45 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:46.071964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657c4f3-ed3f-444e-8476-c8d4d5ddc864 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:46.073681 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c657c4f3-ed3f-444e-8476-c8d4d5ddc864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:46.154044 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657c4f3-ed3f-444e-8476-c8d4d5ddc864 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:46.157834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4b1e1-de45-452e-98ec-359e83aee966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:46.158521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4b1e1-de45-452e-98ec-359e83aee966 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:46.158806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4b1e1-de45-452e-98ec-359e83aee966 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:46.159094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4b1e1-de45-452e-98ec-359e83aee966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:46.169341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4b1e1-de45-452e-98ec-359e83aee966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:46.170823 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4b1e1-de45-452e-98ec-359e83aee966 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:46.185740 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1034/2081] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:46 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:46.581715 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d78e-ebac-49f1-8a0c-b88750f63ce6 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:46.583310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2162d78e-ebac-49f1-8a0c-b88750f63ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:46.606380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4b1e1-de45-452e-98ec-359e83aee966 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:46.700856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d78e-ebac-49f1-8a0c-b88750f63ce6 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:46.705991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:46.707097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:46.707685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:46.708048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] PATH_INFO: `/v3/projects/3c2b2712835840c79986dfe7e112f028` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:46.709413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2b2712835840c79986dfe7e112f028)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:46.711790 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:46.731272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4b1e1-de45-452e-98ec-359e83aee966 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:46.738103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:46.738103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:46.739336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:46.739336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] PATH_INFO: `/v3/users/156a1a6c892e4de7bd390c6da89047db` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:46.740190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] RBAC: Authorizing `identity:delete_user(user_id=156a1a6c892e4de7bd390c6da89047db)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:46.751470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:47.138747 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156a1a6c892e4de7bd390c6da89047db'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.141652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2b2712835840c79986dfe7e112f028', 'request_id': 'req-5d84e212-43cb-409a-a409-db3e9f2a32b4'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.151174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156a1a6c892e4de7bd390c6da89047db'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.151909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156a1a6c892e4de7bd390c6da89047db'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.159214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156a1a6c892e4de7bd390c6da89047db'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.298007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2b2712835840c79986dfe7e112f028', 'request_id': 'req-5d84e212-43cb-409a-a409-db3e9f2a32b4'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.309369 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2b2712835840c79986dfe7e112f028', 'request_id': 'req-5d84e212-43cb-409a-a409-db3e9f2a32b4'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.322844 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] The token cache is being invalidate because project 3c2b2712835840c79986dfe7e112f028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:47.323200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.326017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.326917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1048/2082] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:46 2021] DELETE /identity/v3/projects/3c2b2712835840c79986dfe7e112f028 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:47.330854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:47.333126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:47.412964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e212-43cb-409a-a409-db3e9f2a32b4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:47.422403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c3d937e0-a55c-49cd-8fae-39794338847a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156a1a6c892e4de7bd390c6da89047db'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.430880 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1035/2083] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:46 2021] DELETE /identity/v3/users/156a1a6c892e4de7bd390c6da89047db => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:47.431980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:47.432943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:47.433739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:47.434157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] PATH_INFO: `/v3/users/064372e69b754ad69f9c2d28193c6e89` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:47.435986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc2df-44e0-4bbc-9847-7c4c57983242 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:47.436323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc2df-44e0-4bbc-9847-7c4c57983242 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:47.436640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc2df-44e0-4bbc-9847-7c4c57983242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:47.443312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=064372e69b754ad69f9c2d28193c6e89)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:47.447568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:47.479093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b1cdc2df-44e0-4bbc-9847-7c4c57983242 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:47.481647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b1cdc2df-44e0-4bbc-9847-7c4c57983242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:47.582899 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1036/2084] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:47.593940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc2df-44e0-4bbc-9847-7c4c57983242 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:47.597501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b1cdc2df-44e0-4bbc-9847-7c4c57983242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:47.707483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc2df-44e0-4bbc-9847-7c4c57983242 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:47.711713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac0308-613b-4bad-8570-c65f7f663a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:47.712461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac0308-613b-4bad-8570-c65f7f663a49 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:47.712752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac0308-613b-4bad-8570-c65f7f663a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:47.713034 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac0308-613b-4bad-8570-c65f7f663a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:47.725051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac0308-613b-4bad-8570-c65f7f663a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:47.726624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac0308-613b-4bad-8570-c65f7f663a49 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:47.741163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1037/2085] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:47.743125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064372e69b754ad69f9c2d28193c6e89'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.743860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064372e69b754ad69f9c2d28193c6e89'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.748688 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064372e69b754ad69f9c2d28193c6e89'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.766081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064372e69b754ad69f9c2d28193c6e89'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.895349 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064372e69b754ad69f9c2d28193c6e89'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.921053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1049/2086] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:47 2021] DELETE /identity/v3/users/064372e69b754ad69f9c2d28193c6e89 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:48.720370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac0308-613b-4bad-8570-c65f7f663a49 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:48.720370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-76ac0308-613b-4bad-8570-c65f7f663a49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:48.739387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac0308-613b-4bad-8570-c65f7f663a49 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:48.842782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:48.843927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.844544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.845056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] PATH_INFO: `/v3/projects/48aa1377de2045e38830bc5e04633dbc` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.846719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48aa1377de2045e38830bc5e04633dbc)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:48.849710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:49.131270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48aa1377de2045e38830bc5e04633dbc', 'request_id': 'req-c0c4b9af-639a-4432-9506-d5ef68085248'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.133293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:49.135993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:49.168406 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48aa1377de2045e38830bc5e04633dbc', 'request_id': 'req-c0c4b9af-639a-4432-9506-d5ef68085248'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.169706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f7453-aa5a-41ab-bac5-2c21d069cb49 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:49.197442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48aa1377de2045e38830bc5e04633dbc', 'request_id': 'req-c0c4b9af-639a-4432-9506-d5ef68085248'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.301313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] The token cache is being invalidate because project 48aa1377de2045e38830bc5e04633dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:49.301683 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.303204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.306629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1038/2087] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:48 2021] DELETE /identity/v3/projects/48aa1377de2045e38830bc5e04633dbc => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:49.311902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:49.313502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:49.335099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:49.336636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.337107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.337551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] PATH_INFO: `/v3/projects/8043b09571e341e8b47ecbb200ef3d77` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.340952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8043b09571e341e8b47ecbb200ef3d77)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:49.344991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:49.448078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4b9af-639a-4432-9506-d5ef68085248 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:49.455248 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:49.456708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.457388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.457919 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] PATH_INFO: `/v3/users/8ff2034fb011419093b597385362c3d8` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.459544 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff2034fb011419093b597385362c3d8)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:49.462487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:49.529057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8043b09571e341e8b47ecbb200ef3d77', 'request_id': 'req-7e41ae3a-110f-46d0-bf30-9a32992964d9'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.648615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8043b09571e341e8b47ecbb200ef3d77', 'request_id': 'req-7e41ae3a-110f-46d0-bf30-9a32992964d9'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.660729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8043b09571e341e8b47ecbb200ef3d77', 'request_id': 'req-7e41ae3a-110f-46d0-bf30-9a32992964d9'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.687184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] The token cache is being invalidate because project 8043b09571e341e8b47ecbb200ef3d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:49.689614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.689614 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7e41ae3a-110f-46d0-bf30-9a32992964d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.696559 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1050/2088] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:49 2021] DELETE /identity/v3/projects/8043b09571e341e8b47ecbb200ef3d77 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:49.706376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361f05-2065-46ed-9921-9c0b9fd2a025 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.706666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361f05-2065-46ed-9921-9c0b9fd2a025 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.706944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361f05-2065-46ed-9921-9c0b9fd2a025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.744393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-71361f05-2065-46ed-9921-9c0b9fd2a025 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:49.745465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-71361f05-2065-46ed-9921-9c0b9fd2a025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:49.784141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff2034fb011419093b597385362c3d8'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.847111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff2034fb011419093b597385362c3d8'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.849308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff2034fb011419093b597385362c3d8'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.867356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff2034fb011419093b597385362c3d8'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.877636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1051/2089] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:49.885444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe405238-90e2-4f05-9041-e878870bddb4 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.885902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe405238-90e2-4f05-9041-e878870bddb4 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.886397 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe405238-90e2-4f05-9041-e878870bddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.913317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-fe405238-90e2-4f05-9041-e878870bddb4 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:49.915230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-fe405238-90e2-4f05-9041-e878870bddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:49.926889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1052/2090] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:49.930933 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe405238-90e2-4f05-9041-e878870bddb4 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:49.942459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe405238-90e2-4f05-9041-e878870bddb4 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:49.948297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c01b4-07c6-4d81-a776-4a47d30eaffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:49.949245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c01b4-07c6-4d81-a776-4a47d30eaffe admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.949623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c01b4-07c6-4d81-a776-4a47d30eaffe admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.949876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c01b4-07c6-4d81-a776-4a47d30eaffe admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.951225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c01b4-07c6-4d81-a776-4a47d30eaffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:49.951225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c01b4-07c6-4d81-a776-4a47d30eaffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:49.953166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c01b4-07c6-4d81-a776-4a47d30eaffe admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:49.971658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1053/2091] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:45:49.973499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c01b4-07c6-4d81-a776-4a47d30eaffe admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:49.985465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c01b4-07c6-4d81-a776-4a47d30eaffe admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:49.987831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff2034fb011419093b597385362c3d8'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.995035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699dae8-4e9c-4007-9e69-441610071279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:49.996635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699dae8-4e9c-4007-9e69-441610071279 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.997024 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699dae8-4e9c-4007-9e69-441610071279 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.997892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699dae8-4e9c-4007-9e69-441610071279 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.998718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1039/2092] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:49 2021] DELETE /identity/v3/users/8ff2034fb011419093b597385362c3d8 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:49.998962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699dae8-4e9c-4007-9e69-441610071279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:50.001130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699dae8-4e9c-4007-9e69-441610071279 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:50.139194 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1054/2093] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:49 2021] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:50.144369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:50.148024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:50.258577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8937b-df7d-407f-84a3-971bf85c99df admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:50.342842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7d96-bc3a-49ac-8bd9-c6f57590ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:50.343634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7d96-bc3a-49ac-8bd9-c6f57590ecaa admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:50.343994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7d96-bc3a-49ac-8bd9-c6f57590ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:50.344496 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7d96-bc3a-49ac-8bd9-c6f57590ecaa admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:50.345317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da7d96-bc3a-49ac-8bd9-c6f57590ecaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:50.347333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da7d96-bc3a-49ac-8bd9-c6f57590ecaa admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:50.580773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1040/2094] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:50 2021] POST /identity/v3/users => generated 287 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:50.581400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699dae8-4e9c-4007-9e69-441610071279 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:50.595752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699dae8-4e9c-4007-9e69-441610071279 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:50.601905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a05b9-2a32-4378-b33a-f19828d938fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:50.603161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a05b9-2a32-4378-b33a-f19828d938fa admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:50.603373 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a05b9-2a32-4378-b33a-f19828d938fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:50.603881 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a05b9-2a32-4378-b33a-f19828d938fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:50.604750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a05b9-2a32-4378-b33a-f19828d938fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:50.619494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a05b9-2a32-4378-b33a-f19828d938fa admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:50.626359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7d96-bc3a-49ac-8bd9-c6f57590ecaa admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:50.626923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1055/2095] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:50 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:50.639613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7d96-bc3a-49ac-8bd9-c6f57590ecaa admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:50.646638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26be4b-26a7-4f27-932b-2bcfd64f67ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:50.647387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26be4b-26a7-4f27-932b-2bcfd64f67ce admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:50.664926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26be4b-26a7-4f27-932b-2bcfd64f67ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:50.664926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26be4b-26a7-4f27-932b-2bcfd64f67ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:50.664926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26be4b-26a7-4f27-932b-2bcfd64f67ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:50.664926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26be4b-26a7-4f27-932b-2bcfd64f67ce admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:50.672624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a05b9-2a32-4378-b33a-f19828d938fa admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:50.673281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1041/2096] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:50 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:50.687783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a05b9-2a32-4378-b33a-f19828d938fa admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:50.706624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2933f-3bfc-4a78-8d84-f5846d9c0760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:50.706624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2933f-3bfc-4a78-8d84-f5846d9c0760 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:50.706624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2933f-3bfc-4a78-8d84-f5846d9c0760 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:50.706624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2933f-3bfc-4a78-8d84-f5846d9c0760 admin admin] PATH_INFO: `/v3/projects/41895413741246f8a33643762152d150/users/deb5a31a0b3f4505adefdda434d9dbcb/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:50.722812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2933f-3bfc-4a78-8d84-f5846d9c0760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41895413741246f8a33643762152d150, user_id=deb5a31a0b3f4505adefdda434d9dbcb, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:50.725655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2933f-3bfc-4a78-8d84-f5846d9c0760 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:50.873881 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1056/2097] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:50 2021] PUT /identity/v3/projects/41895413741246f8a33643762152d150/users/deb5a31a0b3f4505adefdda434d9dbcb/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:50.884053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da00572-0a08-42eb-910d-24178f7e71c4 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:50.889604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da00572-0a08-42eb-910d-24178f7e71c4 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:50.889724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26be4b-26a7-4f27-932b-2bcfd64f67ce admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:50.890157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da00572-0a08-42eb-910d-24178f7e71c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:50.890255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4a26be4b-26a7-4f27-932b-2bcfd64f67ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:50.912028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26be4b-26a7-4f27-932b-2bcfd64f67ce admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:50.940450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2da00572-0a08-42eb-910d-24178f7e71c4 None None] MFA Rules not processed for user `deb5a31a0b3f4505adefdda434d9dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:50.943799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2da00572-0a08-42eb-910d-24178f7e71c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:51.072937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1057/2098] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:50 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:51.078465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da00572-0a08-42eb-910d-24178f7e71c4 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:51.103302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:51.104537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.105049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.105967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] PATH_INFO: `/v3/projects/afafb56098dc46bf891049790931016f` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.107761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afafb56098dc46bf891049790931016f)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:51.110527 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:51.178335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da00572-0a08-42eb-910d-24178f7e71c4 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:51.185118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e489-4473-4098-be7f-eaf2170a2c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:51.186394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e489-4473-4098-be7f-eaf2170a2c9a admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.186682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e489-4473-4098-be7f-eaf2170a2c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.186960 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e489-4473-4098-be7f-eaf2170a2c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.187665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2e489-4473-4098-be7f-eaf2170a2c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:51.190168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2e489-4473-4098-be7f-eaf2170a2c9a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:51.239075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afafb56098dc46bf891049790931016f', 'request_id': 'req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.247508 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afafb56098dc46bf891049790931016f', 'request_id': 'req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.253934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afafb56098dc46bf891049790931016f', 'request_id': 'req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.321015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1058/2099] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:51 2021] POST /identity/v3/projects => generated 371 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:51.325236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e489-4473-4098-be7f-eaf2170a2c9a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:51.347380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] The token cache is being invalidate because project afafb56098dc46bf891049790931016f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:51.355988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.355988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ad9262f6-03f9-42b2-bbe9-bc446f2202a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.355988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1042/2100] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:50 2021] DELETE /identity/v3/projects/afafb56098dc46bf891049790931016f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:51.359401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d224a-66cb-4908-9125-eff0f91fb17c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.359978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d224a-66cb-4908-9125-eff0f91fb17c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.360615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d224a-66cb-4908-9125-eff0f91fb17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.417889 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f79d224a-66cb-4908-9125-eff0f91fb17c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:51.418856 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f79d224a-66cb-4908-9125-eff0f91fb17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:51.442728 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1043/2101] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:51.451028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded251ca-f4b5-4e92-a27b-7e2466f1a2d4 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.451321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded251ca-f4b5-4e92-a27b-7e2466f1a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.451608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded251ca-f4b5-4e92-a27b-7e2466f1a2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.463672 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e489-4473-4098-be7f-eaf2170a2c9a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:51.477251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ded251ca-f4b5-4e92-a27b-7e2466f1a2d4 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:51.481344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ded251ca-f4b5-4e92-a27b-7e2466f1a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:51.485814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4dc08-e6ee-4556-92ab-7c559fdcb0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:51.486453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4dc08-e6ee-4556-92ab-7c559fdcb0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.486739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4dc08-e6ee-4556-92ab-7c559fdcb0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.487015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4dc08-e6ee-4556-92ab-7c559fdcb0f7 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.487716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4dc08-e6ee-4556-92ab-7c559fdcb0f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:51.491576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4dc08-e6ee-4556-92ab-7c559fdcb0f7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:51.504567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1044/2102] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:51.509083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded251ca-f4b5-4e92-a27b-7e2466f1a2d4 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:51.539538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded251ca-f4b5-4e92-a27b-7e2466f1a2d4 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:51.550725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f087d-45d7-433c-a325-2cfb15a910a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:51.551414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f087d-45d7-433c-a325-2cfb15a910a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.551700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f087d-45d7-433c-a325-2cfb15a910a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.551979 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f087d-45d7-433c-a325-2cfb15a910a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.554399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f087d-45d7-433c-a325-2cfb15a910a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:51.554717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f087d-45d7-433c-a325-2cfb15a910a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:51.556436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f087d-45d7-433c-a325-2cfb15a910a2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:51.574943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1045/2103] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:51.579600 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f087d-45d7-433c-a325-2cfb15a910a2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:51.593769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f087d-45d7-433c-a325-2cfb15a910a2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:51.600332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0e7af-c228-4754-9a5e-b8e267a45e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:51.601524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0e7af-c228-4754-9a5e-b8e267a45e74 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.602076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0e7af-c228-4754-9a5e-b8e267a45e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.602389 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0e7af-c228-4754-9a5e-b8e267a45e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.603228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0e7af-c228-4754-9a5e-b8e267a45e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:51.605504 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0e7af-c228-4754-9a5e-b8e267a45e74 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:51.659589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1059/2104] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:51 2021] POST /identity/v3/users => generated 292 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:51.663156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4dc08-e6ee-4556-92ab-7c559fdcb0f7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:51.665395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d3e4dc08-e6ee-4556-92ab-7c559fdcb0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:51.680843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4dc08-e6ee-4556-92ab-7c559fdcb0f7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:51.686369 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a24cbd-1ab5-45fb-baf6-c47532c5d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:51.687029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a24cbd-1ab5-45fb-baf6-c47532c5d4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.687317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a24cbd-1ab5-45fb-baf6-c47532c5d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.687592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a24cbd-1ab5-45fb-baf6-c47532c5d4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.688431 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a24cbd-1ab5-45fb-baf6-c47532c5d4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:51.690160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a24cbd-1ab5-45fb-baf6-c47532c5d4b5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:51.704993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1060/2105] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:51 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:51.708828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a24cbd-1ab5-45fb-baf6-c47532c5d4b5 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:51.724821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a24cbd-1ab5-45fb-baf6-c47532c5d4b5 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:51.731487 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f3ad-72f1-46b3-ad51-34fe6cffe677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:51.732526 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f3ad-72f1-46b3-ad51-34fe6cffe677 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.732812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f3ad-72f1-46b3-ad51-34fe6cffe677 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.733090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f3ad-72f1-46b3-ad51-34fe6cffe677 admin admin] PATH_INFO: `/v3/projects/c21c310439d347afad3d27b3f3021448/users/f6343a06732248ecba1536b8b5e18b2b/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.751757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999f3ad-72f1-46b3-ad51-34fe6cffe677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21c310439d347afad3d27b3f3021448, user_id=f6343a06732248ecba1536b8b5e18b2b, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:51.754530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999f3ad-72f1-46b3-ad51-34fe6cffe677 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:51.846455 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1046/2106] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:51 2021] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:51.848143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0e7af-c228-4754-9a5e-b8e267a45e74 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:51.943056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0e7af-c228-4754-9a5e-b8e267a45e74 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:51.951196 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1061/2107] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:51 2021] PUT /identity/v3/projects/c21c310439d347afad3d27b3f3021448/users/f6343a06732248ecba1536b8b5e18b2b/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:51.954422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f3ad-72f1-46b3-ad51-34fe6cffe677 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:52.037526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b410fd-0c0f-44dc-a9ec-fd44b00187e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:52.038569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f3ad-72f1-46b3-ad51-34fe6cffe677 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:52.039085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b410fd-0c0f-44dc-a9ec-fd44b00187e6 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.039533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b410fd-0c0f-44dc-a9ec-fd44b00187e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.039984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b410fd-0c0f-44dc-a9ec-fd44b00187e6 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.040722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b410fd-0c0f-44dc-a9ec-fd44b00187e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:52.043317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b410fd-0c0f-44dc-a9ec-fd44b00187e6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:52.045419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aa0c2-63a8-4213-b73f-fba695c846c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:52.046387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aa0c2-63a8-4213-b73f-fba695c846c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.046883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aa0c2-63a8-4213-b73f-fba695c846c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.047502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aa0c2-63a8-4213-b73f-fba695c846c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.048490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3aa0c2-63a8-4213-b73f-fba695c846c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:52.050329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3aa0c2-63a8-4213-b73f-fba695c846c1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:52.063330 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1062/2108] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:51 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:52.067479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aa0c2-63a8-4213-b73f-fba695c846c1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:52.077925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aa0c2-63a8-4213-b73f-fba695c846c1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:52.082656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833eeb4-2b69-4e8c-aeaf-1f9ead0084cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:52.083532 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833eeb4-2b69-4e8c-aeaf-1f9ead0084cb admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.083817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833eeb4-2b69-4e8c-aeaf-1f9ead0084cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.084083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833eeb4-2b69-4e8c-aeaf-1f9ead0084cb admin admin] PATH_INFO: `/v3/projects/c21c310439d347afad3d27b3f3021448/users/f6343a06732248ecba1536b8b5e18b2b/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.086106 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833eeb4-2b69-4e8c-aeaf-1f9ead0084cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21c310439d347afad3d27b3f3021448, user_id=f6343a06732248ecba1536b8b5e18b2b, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:52.088798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833eeb4-2b69-4e8c-aeaf-1f9ead0084cb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:52.099745 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1063/2109] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:52 2021] PUT /identity/v3/projects/c21c310439d347afad3d27b3f3021448/users/f6343a06732248ecba1536b8b5e18b2b/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:52.110848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b29fe-e6f7-45c9-8035-29295f800dc8 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.113216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b29fe-e6f7-45c9-8035-29295f800dc8 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.113216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b29fe-e6f7-45c9-8035-29295f800dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.140261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-fc0b29fe-e6f7-45c9-8035-29295f800dc8 None None] MFA Rules not processed for user `f6343a06732248ecba1536b8b5e18b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:52.141885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-fc0b29fe-e6f7-45c9-8035-29295f800dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:52.175661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1047/2110] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:51 2021] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:52.182149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b410fd-0c0f-44dc-a9ec-fd44b00187e6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:52.207535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b410fd-0c0f-44dc-a9ec-fd44b00187e6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:52.238139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1064/2111] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:52 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:52.256889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b29fe-e6f7-45c9-8035-29295f800dc8 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:52.259264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-fc0b29fe-e6f7-45c9-8035-29295f800dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:52.342576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f31bf-dd03-47a7-89be-84614de42ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:52.343268 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f31bf-dd03-47a7-89be-84614de42ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.344048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f31bf-dd03-47a7-89be-84614de42ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.344336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f31bf-dd03-47a7-89be-84614de42ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.345251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f31bf-dd03-47a7-89be-84614de42ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:52.347814 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f31bf-dd03-47a7-89be-84614de42ef1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:52.373358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1048/2112] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:52 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:52.377959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f31bf-dd03-47a7-89be-84614de42ef1 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:52.397542 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f31bf-dd03-47a7-89be-84614de42ef1 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:52.397652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b29fe-e6f7-45c9-8035-29295f800dc8 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:52.400872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339f0d-cff3-491c-88c0-994267cd438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:52.401628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339f0d-cff3-491c-88c0-994267cd438a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.405454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339f0d-cff3-491c-88c0-994267cd438a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.405865 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339f0d-cff3-491c-88c0-994267cd438a admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.407631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339f0d-cff3-491c-88c0-994267cd438a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:52.408550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003504d4-06f4-4f76-bb34-0f0f402d2262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:52.408922 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339f0d-cff3-491c-88c0-994267cd438a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:52.409866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003504d4-06f4-4f76-bb34-0f0f402d2262 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.410166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003504d4-06f4-4f76-bb34-0f0f402d2262 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.410453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003504d4-06f4-4f76-bb34-0f0f402d2262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.422123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1049/2113] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:52 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:52.428596 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339f0d-cff3-491c-88c0-994267cd438a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:52.433070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003504d4-06f4-4f76-bb34-0f0f402d2262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:52.434755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003504d4-06f4-4f76-bb34-0f0f402d2262 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:52.448547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339f0d-cff3-491c-88c0-994267cd438a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:52.449773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1065/2114] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:52 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:52.467259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855a4ed-e610-4621-99e4-d4af099bf01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:52.468162 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855a4ed-e610-4621-99e4-d4af099bf01c admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.468467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855a4ed-e610-4621-99e4-d4af099bf01c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.468746 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855a4ed-e610-4621-99e4-d4af099bf01c admin admin] PATH_INFO: `/v3/projects/5066cda710174cba89b81095bbff2192/users/12937ff90ed14b619205b95743126b9c/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.505912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855a4ed-e610-4621-99e4-d4af099bf01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5066cda710174cba89b81095bbff2192, user_id=12937ff90ed14b619205b95743126b9c, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:52.513645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855a4ed-e610-4621-99e4-d4af099bf01c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:52.593382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1050/2115] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:52 2021] PUT /identity/v3/projects/5066cda710174cba89b81095bbff2192/users/12937ff90ed14b619205b95743126b9c/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:52.617112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4835c16-f382-4462-acfa-cf3ed00b6f54 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.621316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4835c16-f382-4462-acfa-cf3ed00b6f54 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.621316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4835c16-f382-4462-acfa-cf3ed00b6f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.686705 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e4835c16-f382-4462-acfa-cf3ed00b6f54 None None] MFA Rules not processed for user `12937ff90ed14b619205b95743126b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:52.688852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e4835c16-f382-4462-acfa-cf3ed00b6f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:52.907534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1066/2116] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:52 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:52.913870 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855a4ed-e610-4621-99e4-d4af099bf01c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.028081 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855a4ed-e610-4621-99e4-d4af099bf01c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.049141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0f400-c7c3-43a5-ac77-58ba3abccf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.051716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0f400-c7c3-43a5-ac77-58ba3abccf1e admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.060961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0f400-c7c3-43a5-ac77-58ba3abccf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.061892 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0f400-c7c3-43a5-ac77-58ba3abccf1e admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.068056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0f400-c7c3-43a5-ac77-58ba3abccf1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.077047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0f400-c7c3-43a5-ac77-58ba3abccf1e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.211167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1051/2117] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:52 2021] POST /identity/v3/projects => generated 385 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:53.221606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4835c16-f382-4462-acfa-cf3ed00b6f54 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.235343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4835c16-f382-4462-acfa-cf3ed00b6f54 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.351582 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ac944-c256-404b-a4a5-0f35da98117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.353022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ac944-c256-404b-a4a5-0f35da98117f admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.353508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ac944-c256-404b-a4a5-0f35da98117f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.353789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ac944-c256-404b-a4a5-0f35da98117f admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.354504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ac944-c256-404b-a4a5-0f35da98117f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.357414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ac944-c256-404b-a4a5-0f35da98117f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.478292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1067/2118] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:53 2021] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:53.480698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0f400-c7c3-43a5-ac77-58ba3abccf1e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.496305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0f400-c7c3-43a5-ac77-58ba3abccf1e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.509691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bca14-28aa-4d81-b604-44c787a4b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.511613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bca14-28aa-4d81-b604-44c787a4b5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.511613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bca14-28aa-4d81-b604-44c787a4b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.511969 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ac944-c256-404b-a4a5-0f35da98117f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.512077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bca14-28aa-4d81-b604-44c787a4b5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.513139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bca14-28aa-4d81-b604-44c787a4b5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.515408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bca14-28aa-4d81-b604-44c787a4b5b6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.533683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ac944-c256-404b-a4a5-0f35da98117f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.539066 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1052/2119] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:53 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:53.542023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.543617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.544058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.544461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] PATH_INFO: `/v3/users/deb5a31a0b3f4505adefdda434d9dbcb` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.546075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb5a31a0b3f4505adefdda434d9dbcb)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.548208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.554940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bca14-28aa-4d81-b604-44c787a4b5b6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.587987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bca14-28aa-4d81-b604-44c787a4b5b6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.593822 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded71d5-17a4-4013-a741-ccba87816510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.594672 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded71d5-17a4-4013-a741-ccba87816510 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.595059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded71d5-17a4-4013-a741-ccba87816510 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.595514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded71d5-17a4-4013-a741-ccba87816510 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.596471 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded71d5-17a4-4013-a741-ccba87816510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.600483 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded71d5-17a4-4013-a741-ccba87816510 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.619797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1053/2120] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:53 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:53.622212 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded71d5-17a4-4013-a741-ccba87816510 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.641090 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded71d5-17a4-4013-a741-ccba87816510 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.650957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25192f00-6c26-4acc-82d6-dd04562a4c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.657875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25192f00-6c26-4acc-82d6-dd04562a4c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.657875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25192f00-6c26-4acc-82d6-dd04562a4c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.657875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25192f00-6c26-4acc-82d6-dd04562a4c0e admin admin] PATH_INFO: `/v3/projects/d6eb7e11005b4fc6bc2c52cb2ff20121/users/81e3d8c73cf14db9b40f586b509c618b/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.674389 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25192f00-6c26-4acc-82d6-dd04562a4c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6eb7e11005b4fc6bc2c52cb2ff20121, user_id=81e3d8c73cf14db9b40f586b509c618b, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.688427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25192f00-6c26-4acc-82d6-dd04562a4c0e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.844047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1054/2121] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:53 2021] PUT /identity/v3/projects/d6eb7e11005b4fc6bc2c52cb2ff20121/users/81e3d8c73cf14db9b40f586b509c618b/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:53.845713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894db4cf-087e-4175-bd79-308fd53ad0df None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.846013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894db4cf-087e-4175-bd79-308fd53ad0df None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.848725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894db4cf-087e-4175-bd79-308fd53ad0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.850508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb5a31a0b3f4505adefdda434d9dbcb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.860980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb5a31a0b3f4505adefdda434d9dbcb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.863902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb5a31a0b3f4505adefdda434d9dbcb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.887240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb5a31a0b3f4505adefdda434d9dbcb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.915000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-894db4cf-087e-4175-bd79-308fd53ad0df None None] MFA Rules not processed for user `81e3d8c73cf14db9b40f586b509c618b`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:53.916238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-894db4cf-087e-4175-bd79-308fd53ad0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:53.976036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb5a31a0b3f4505adefdda434d9dbcb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.991093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1055/2122] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:53 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:53.992887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5ed76-02ac-4ed6-b3a0-ce92ead486a4 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.993349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5ed76-02ac-4ed6-b3a0-ce92ead486a4 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.993782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5ed76-02ac-4ed6-b3a0-ce92ead486a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.001930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1068/2123] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:53 2021] DELETE /identity/v3/users/deb5a31a0b3f4505adefdda434d9dbcb => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:54.002863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.006574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.067176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-51b5ed76-02ac-4ed6-b3a0-ce92ead486a4 None None] MFA Rules not processed for user `541c688efdf8455c9a083ca11f2678be`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:54.071617 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-51b5ed76-02ac-4ed6-b3a0-ce92ead486a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.128567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae053c03-c282-48cf-98cb-1bd04d3e97cd admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.133851 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06cace-e322-476e-b536-0f7c9358f832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.134035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06cace-e322-476e-b536-0f7c9358f832 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.134320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06cace-e322-476e-b536-0f7c9358f832 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.134592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06cace-e322-476e-b536-0f7c9358f832 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.135372 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06cace-e322-476e-b536-0f7c9358f832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.138557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06cace-e322-476e-b536-0f7c9358f832 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.162492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1056/2124] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:53 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:54.162492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5408e-557d-480f-ac38-4d5473c7d58b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.162492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5408e-557d-480f-ac38-4d5473c7d58b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.162492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5408e-557d-480f-ac38-4d5473c7d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.181176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-92e5408e-557d-480f-ac38-4d5473c7d58b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:54.182976 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-92e5408e-557d-480f-ac38-4d5473c7d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.192931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1057/2125] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:54.193670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5408e-557d-480f-ac38-4d5473c7d58b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.195087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-92e5408e-557d-480f-ac38-4d5473c7d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.211032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5408e-557d-480f-ac38-4d5473c7d58b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.222755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a340-049e-4355-b353-1060a0d58f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.222755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a340-049e-4355-b353-1060a0d58f0c admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.222755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a340-049e-4355-b353-1060a0d58f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.222755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a340-049e-4355-b353-1060a0d58f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.223104 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a340-049e-4355-b353-1060a0d58f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.223104 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a340-049e-4355-b353-1060a0d58f0c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.270759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1069/2126] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:54 2021] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:54.271703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06cace-e322-476e-b536-0f7c9358f832 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.274162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-cd06cace-e322-476e-b536-0f7c9358f832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.333405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06cace-e322-476e-b536-0f7c9358f832 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.337824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036044f5-7099-4a55-a0f6-7b3345381f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.338719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036044f5-7099-4a55-a0f6-7b3345381f32 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.339173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036044f5-7099-4a55-a0f6-7b3345381f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.340125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036044f5-7099-4a55-a0f6-7b3345381f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.389753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1058/2127] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:54 2021] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:54.390843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a340-049e-4355-b353-1060a0d58f0c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.437255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036044f5-7099-4a55-a0f6-7b3345381f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.438714 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036044f5-7099-4a55-a0f6-7b3345381f32 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.449499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1070/2128] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:54.450412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036044f5-7099-4a55-a0f6-7b3345381f32 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.465885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a340-049e-4355-b353-1060a0d58f0c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.473070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036044f5-7099-4a55-a0f6-7b3345381f32 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.477259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc12f-5acf-4e7e-adeb-59cc59f3aa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.480449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f415e8-d069-4fc4-84d9-75b3630267de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.481226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f415e8-d069-4fc4-84d9-75b3630267de admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.481633 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f415e8-d069-4fc4-84d9-75b3630267de admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.482054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f415e8-d069-4fc4-84d9-75b3630267de admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.482852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f415e8-d069-4fc4-84d9-75b3630267de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.484459 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc12f-5acf-4e7e-adeb-59cc59f3aa63 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.489274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc12f-5acf-4e7e-adeb-59cc59f3aa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.489592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f415e8-d069-4fc4-84d9-75b3630267de admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.489700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc12f-5acf-4e7e-adeb-59cc59f3aa63 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.489700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dc12f-5acf-4e7e-adeb-59cc59f3aa63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.490318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dc12f-5acf-4e7e-adeb-59cc59f3aa63 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.574384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1071/2129] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:54 2021] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:54.575575 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f415e8-d069-4fc4-84d9-75b3630267de admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.587888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f415e8-d069-4fc4-84d9-75b3630267de admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.594570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3a599-c4f1-4483-8f8f-d95837222747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.595696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a599-c4f1-4483-8f8f-d95837222747 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.595696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a599-c4f1-4483-8f8f-d95837222747 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.595951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a599-c4f1-4483-8f8f-d95837222747 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.596880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3a599-c4f1-4483-8f8f-d95837222747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.598749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3a599-c4f1-4483-8f8f-d95837222747 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.611638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1059/2130] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:54 2021] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:54.614118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1072/2131] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:54.618280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3a599-c4f1-4483-8f8f-d95837222747 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.618445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc12f-5acf-4e7e-adeb-59cc59f3aa63 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.630509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3a599-c4f1-4483-8f8f-d95837222747 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.631202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc12f-5acf-4e7e-adeb-59cc59f3aa63 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.638202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ce4c9-cf6a-4563-9b17-0787d301b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.639626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce4c9-cf6a-4563-9b17-0787d301b30d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.640069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce4c9-cf6a-4563-9b17-0787d301b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.640529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce4c9-cf6a-4563-9b17-0787d301b30d admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.640642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091d38-14d7-405a-9ee5-d179fb3b45bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.641507 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091d38-14d7-405a-9ee5-d179fb3b45bb admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.641782 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ce4c9-cf6a-4563-9b17-0787d301b30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.641923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091d38-14d7-405a-9ee5-d179fb3b45bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.642055 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091d38-14d7-405a-9ee5-d179fb3b45bb admin admin] PATH_INFO: `/v3/projects/ae4d88312e7842e784da531b68ab996c/users/ead952b423654531ac06e9ddb3c693b3/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.643414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ce4c9-cf6a-4563-9b17-0787d301b30d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.662397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1060/2132] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:54.662613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85091d38-14d7-405a-9ee5-d179fb3b45bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4d88312e7842e784da531b68ab996c, user_id=ead952b423654531ac06e9ddb3c693b3, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.663857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ce4c9-cf6a-4563-9b17-0787d301b30d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.664800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85091d38-14d7-405a-9ee5-d179fb3b45bb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.674750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ce4c9-cf6a-4563-9b17-0787d301b30d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.682783 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9f0d-d8ad-4f59-88dc-d8ad3c01eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.683716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9f0d-d8ad-4f59-88dc-d8ad3c01eb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.683942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9f0d-d8ad-4f59-88dc-d8ad3c01eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.684220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9f0d-d8ad-4f59-88dc-d8ad3c01eb07 admin admin] PATH_INFO: `/v3/projects/828f18e8ad0f437f9c3051170bce05ff/users/014b3bc91599476fbd07a05f121b875d/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.706750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a9f0d-d8ad-4f59-88dc-d8ad3c01eb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828f18e8ad0f437f9c3051170bce05ff, user_id=014b3bc91599476fbd07a05f121b875d, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.709545 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a9f0d-d8ad-4f59-88dc-d8ad3c01eb07 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.806235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1073/2133] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:54 2021] PUT /identity/v3/projects/ae4d88312e7842e784da531b68ab996c/users/ead952b423654531ac06e9ddb3c693b3/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:54.811437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091d38-14d7-405a-9ee5-d179fb3b45bb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.868207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1061/2134] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:54 2021] PUT /identity/v3/projects/828f18e8ad0f437f9c3051170bce05ff/users/014b3bc91599476fbd07a05f121b875d/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:54.872868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9f0d-d8ad-4f59-88dc-d8ad3c01eb07 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.929433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091d38-14d7-405a-9ee5-d179fb3b45bb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.957418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9f0d-d8ad-4f59-88dc-d8ad3c01eb07 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.963001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680207f-7f8c-4793-9a36-e99b07a9da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.963893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680207f-7f8c-4793-9a36-e99b07a9da0d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.964396 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680207f-7f8c-4793-9a36-e99b07a9da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.964863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680207f-7f8c-4793-9a36-e99b07a9da0d admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.966128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680207f-7f8c-4793-9a36-e99b07a9da0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.968258 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680207f-7f8c-4793-9a36-e99b07a9da0d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.981796 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1062/2135] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:54.997470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680207f-7f8c-4793-9a36-e99b07a9da0d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.011946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680207f-7f8c-4793-9a36-e99b07a9da0d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.018435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049da85-6d48-4864-9aa3-f001d7fe4a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.019336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049da85-6d48-4864-9aa3-f001d7fe4a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.019650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049da85-6d48-4864-9aa3-f001d7fe4a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.020621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049da85-6d48-4864-9aa3-f001d7fe4a85 admin admin] PATH_INFO: `/v3/projects/828f18e8ad0f437f9c3051170bce05ff/users/014b3bc91599476fbd07a05f121b875d/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.025384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049da85-6d48-4864-9aa3-f001d7fe4a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828f18e8ad0f437f9c3051170bce05ff, user_id=014b3bc91599476fbd07a05f121b875d, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.031748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049da85-6d48-4864-9aa3-f001d7fe4a85 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.048697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b921-075b-4c3f-8119-493dd3d2d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.049996 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b921-075b-4c3f-8119-493dd3d2d693 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.060509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b921-075b-4c3f-8119-493dd3d2d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.060509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b921-075b-4c3f-8119-493dd3d2d693 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.060509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481b921-075b-4c3f-8119-493dd3d2d693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.061441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1063/2136] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:54 2021] PUT /identity/v3/projects/828f18e8ad0f437f9c3051170bce05ff/users/014b3bc91599476fbd07a05f121b875d/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:55.061557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481b921-075b-4c3f-8119-493dd3d2d693 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.066933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f115-0a10-4a52-ab99-226a6746bfd6 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.067372 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1074/2137] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:55.068228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f115-0a10-4a52-ab99-226a6746bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.068718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f115-0a10-4a52-ab99-226a6746bfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.071215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b921-075b-4c3f-8119-493dd3d2d693 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.102798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b921-075b-4c3f-8119-493dd3d2d693 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.124161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-9d93f115-0a10-4a52-ab99-226a6746bfd6 None None] MFA Rules not processed for user `014b3bc91599476fbd07a05f121b875d`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:55.125557 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9d93f115-0a10-4a52-ab99-226a6746bfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.179746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddccf10-8f27-4f6d-a16b-454face944ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.180902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddccf10-8f27-4f6d-a16b-454face944ae admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.181189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddccf10-8f27-4f6d-a16b-454face944ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.181461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddccf10-8f27-4f6d-a16b-454face944ae admin admin] PATH_INFO: `/v3/projects/ae4d88312e7842e784da531b68ab996c/users/ead952b423654531ac06e9ddb3c693b3/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.188712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddccf10-8f27-4f6d-a16b-454face944ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4d88312e7842e784da531b68ab996c, user_id=ead952b423654531ac06e9ddb3c693b3, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.188861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddccf10-8f27-4f6d-a16b-454face944ae admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.215893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1075/2138] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:55 2021] PUT /identity/v3/projects/ae4d88312e7842e784da531b68ab996c/users/ead952b423654531ac06e9ddb3c693b3/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:55.223417 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddccf10-8f27-4f6d-a16b-454face944ae admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.223417 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1ddccf10-8f27-4f6d-a16b-454face944ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.228047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1064/2139] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:55 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:55.243891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f115-0a10-4a52-ab99-226a6746bfd6 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.246623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9d93f115-0a10-4a52-ab99-226a6746bfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.320987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f115-0a10-4a52-ab99-226a6746bfd6 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.321370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddccf10-8f27-4f6d-a16b-454face944ae admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.328137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.329460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.329921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.330199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] PATH_INFO: `/v3/projects/41895413741246f8a33643762152d150` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.331390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41895413741246f8a33643762152d150)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.333754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.382463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fd65b-79b0-4047-b63e-8c356e41d031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.383158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fd65b-79b0-4047-b63e-8c356e41d031 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.383434 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fd65b-79b0-4047-b63e-8c356e41d031 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.383720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fd65b-79b0-4047-b63e-8c356e41d031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.471166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41895413741246f8a33643762152d150', 'request_id': 'req-48aed75d-e5a6-4987-a086-e3f63e36806d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:55.484202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fd65b-79b0-4047-b63e-8c356e41d031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.485780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fd65b-79b0-4047-b63e-8c356e41d031 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.498403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1065/2140] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:55 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:55.554209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41895413741246f8a33643762152d150', 'request_id': 'req-48aed75d-e5a6-4987-a086-e3f63e36806d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:55.569379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41895413741246f8a33643762152d150', 'request_id': 'req-48aed75d-e5a6-4987-a086-e3f63e36806d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:55.590802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] The token cache is being invalidate because project 41895413741246f8a33643762152d150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:55.591786 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:55.592391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-48aed75d-e5a6-4987-a086-e3f63e36806d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:55.595305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1076/2141] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:55 2021] DELETE /identity/v3/projects/41895413741246f8a33643762152d150 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:55.599110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fd65b-79b0-4047-b63e-8c356e41d031 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.632332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fd65b-79b0-4047-b63e-8c356e41d031 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.706729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.707762 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.708051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.708325 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] PATH_INFO: `/v3/users/f6343a06732248ecba1536b8b5e18b2b` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.709749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6343a06732248ecba1536b8b5e18b2b)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.711909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.948471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e15c-1d73-4166-9443-366eca4428c4 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.949603 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e15c-1d73-4166-9443-366eca4428c4 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.950078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e15c-1d73-4166-9443-366eca4428c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.971426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-5c44e15c-1d73-4166-9443-366eca4428c4 None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:55.971706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6343a06732248ecba1536b8b5e18b2b'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:55.973273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5c44e15c-1d73-4166-9443-366eca4428c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.987267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6343a06732248ecba1536b8b5e18b2b'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:55.988007 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6343a06732248ecba1536b8b5e18b2b'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:55.996866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6343a06732248ecba1536b8b5e18b2b'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:56.056866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1077/2142] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:45:55 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:56.114577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e15c-1d73-4166-9443-366eca4428c4 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:56.117013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5c44e15c-1d73-4166-9443-366eca4428c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:56.125453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6343a06732248ecba1536b8b5e18b2b'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:56.141288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1066/2143] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:45:55 2021] DELETE /identity/v3/users/f6343a06732248ecba1536b8b5e18b2b => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:56.201142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e15c-1d73-4166-9443-366eca4428c4 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.294591 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f291427-3e92-462a-9b09-bbe1f56a27fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.295296 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f291427-3e92-462a-9b09-bbe1f56a27fe service swift] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.295580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f291427-3e92-462a-9b09-bbe1f56a27fe service swift] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.295855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f291427-3e92-462a-9b09-bbe1f56a27fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.297842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9f291427-3e92-462a-9b09-bbe1f56a27fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:56.411580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f291427-3e92-462a-9b09-bbe1f56a27fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.415699 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f291427-3e92-462a-9b09-bbe1f56a27fe service swift] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.426759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1078/2144] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:45:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:56.999620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:57.001371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:57.127883 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23a9d0-d728-487e-b6e4-9f643e6d2145 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:57.141459 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56587ef-c8c7-4b93-a779-2972572ddaaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:57.148517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56587ef-c8c7-4b93-a779-2972572ddaaf service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.148517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56587ef-c8c7-4b93-a779-2972572ddaaf service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.148517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56587ef-c8c7-4b93-a779-2972572ddaaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.148517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a56587ef-c8c7-4b93-a779-2972572ddaaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:57.219213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56587ef-c8c7-4b93-a779-2972572ddaaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:57.221638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56587ef-c8c7-4b93-a779-2972572ddaaf service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:57.234314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1067/2145] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:45:56 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:57.443324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f291427-3e92-462a-9b09-bbe1f56a27fe service swift] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:57.445488 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9f291427-3e92-462a-9b09-bbe1f56a27fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:57.529307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f291427-3e92-462a-9b09-bbe1f56a27fe service swift] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:57.534876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:57.535730 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.536004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.536274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] PATH_INFO: `/v3/projects/c21c310439d347afad3d27b3f3021448` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.537993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21c310439d347afad3d27b3f3021448)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:57.539862 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:57.691869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21c310439d347afad3d27b3f3021448', 'request_id': 'req-d520a0e2-bcbc-4069-b0b7-e82db00ff952'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:57.845606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21c310439d347afad3d27b3f3021448', 'request_id': 'req-d520a0e2-bcbc-4069-b0b7-e82db00ff952'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:57.864909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21c310439d347afad3d27b3f3021448', 'request_id': 'req-d520a0e2-bcbc-4069-b0b7-e82db00ff952'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:57.903239 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] The token cache is being invalidate because project c21c310439d347afad3d27b3f3021448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:57.907533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:57.910256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d520a0e2-bcbc-4069-b0b7-e82db00ff952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:57.913745 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1079/2146] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:45:57 2021] DELETE /identity/v3/projects/c21c310439d347afad3d27b3f3021448 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:57.921849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcf5c5-680a-41c9-a751-deeb11fff824 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.926352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcf5c5-680a-41c9-a751-deeb11fff824 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.926352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcf5c5-680a-41c9-a751-deeb11fff824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.954875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-07fcf5c5-680a-41c9-a751-deeb11fff824 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:57.956123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-07fcf5c5-680a-41c9-a751-deeb11fff824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:58.155039 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1068/2147] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:58.157048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ed02d-c82e-40d8-9843-543fc29db738 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.157264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ed02d-c82e-40d8-9843-543fc29db738 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.157870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ed02d-c82e-40d8-9843-543fc29db738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.192801 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d36ed02d-c82e-40d8-9843-543fc29db738 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:58.194439 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d36ed02d-c82e-40d8-9843-543fc29db738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:58.218489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1080/2148] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:58.219440 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcf5c5-680a-41c9-a751-deeb11fff824 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:58.266656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcf5c5-680a-41c9-a751-deeb11fff824 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:58.290334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa700e0d-a870-4bfb-934f-7b0e28560130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:58.290849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa700e0d-a870-4bfb-934f-7b0e28560130 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.291194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa700e0d-a870-4bfb-934f-7b0e28560130 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.291418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa700e0d-a870-4bfb-934f-7b0e28560130 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.296632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa700e0d-a870-4bfb-934f-7b0e28560130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:58.300122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa700e0d-a870-4bfb-934f-7b0e28560130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:58.303112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa700e0d-a870-4bfb-934f-7b0e28560130 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:58.350173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1069/2149] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:45:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:58.354859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ed02d-c82e-40d8-9843-543fc29db738 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:58.366368 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ed02d-c82e-40d8-9843-543fc29db738 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:58.392033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e273ca4-6a80-48ac-9378-02b62b53f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:58.392738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e273ca4-6a80-48ac-9378-02b62b53f317 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.393015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e273ca4-6a80-48ac-9378-02b62b53f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.393285 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e273ca4-6a80-48ac-9378-02b62b53f317 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.394553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e273ca4-6a80-48ac-9378-02b62b53f317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:58.401032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e273ca4-6a80-48ac-9378-02b62b53f317 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:58.547877 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1081/2150] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:58 2021] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:58.552268 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa700e0d-a870-4bfb-934f-7b0e28560130 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:58.566296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa700e0d-a870-4bfb-934f-7b0e28560130 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:58.649146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea5458-5c22-4dcc-83d7-84ef89b04323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:58.649956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea5458-5c22-4dcc-83d7-84ef89b04323 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.650342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea5458-5c22-4dcc-83d7-84ef89b04323 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.650711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea5458-5c22-4dcc-83d7-84ef89b04323 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.651566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea5458-5c22-4dcc-83d7-84ef89b04323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:58.655216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea5458-5c22-4dcc-83d7-84ef89b04323 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:58.655818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5f58-0c83-4f89-9cb0-4d88cd8cde6f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.656114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5f58-0c83-4f89-9cb0-4d88cd8cde6f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.656445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5f58-0c83-4f89-9cb0-4d88cd8cde6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.695205 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-797c5f58-0c83-4f89-9cb0-4d88cd8cde6f None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:58.696542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-797c5f58-0c83-4f89-9cb0-4d88cd8cde6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:58.796411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1082/2151] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:45:58 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:58.826925 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1070/2152] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:58 2021] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:58.827030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c5f58-0c83-4f89-9cb0-4d88cd8cde6f None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:58.827030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-797c5f58-0c83-4f89-9cb0-4d88cd8cde6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:58.827197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea5458-5c22-4dcc-83d7-84ef89b04323 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:58.846174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea5458-5c22-4dcc-83d7-84ef89b04323 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:58.860867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb0a93-17ff-4607-b26a-269b4b3e300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:58.864736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0a93-17ff-4607-b26a-269b4b3e300f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.868148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0a93-17ff-4607-b26a-269b4b3e300f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.872391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0a93-17ff-4607-b26a-269b4b3e300f admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.875010 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb0a93-17ff-4607-b26a-269b4b3e300f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:58.876973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb0a93-17ff-4607-b26a-269b4b3e300f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:58.902756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1071/2153] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:58 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:58.931754 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb0a93-17ff-4607-b26a-269b4b3e300f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:58.937167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c5f58-0c83-4f89-9cb0-4d88cd8cde6f None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:58.945863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb0a93-17ff-4607-b26a-269b4b3e300f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:58.948038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89026a3-042d-43ce-9cf0-9ecd8bd3c8b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:58.949402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89026a3-042d-43ce-9cf0-9ecd8bd3c8b2 service swift] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.949402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89026a3-042d-43ce-9cf0-9ecd8bd3c8b2 service swift] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.949631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89026a3-042d-43ce-9cf0-9ecd8bd3c8b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.962958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe3a7-5850-4790-a799-ea5357f4b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:58.964299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe3a7-5850-4790-a799-ea5357f4b827 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.964583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe3a7-5850-4790-a799-ea5357f4b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.964863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe3a7-5850-4790-a799-ea5357f4b827 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.965615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe3a7-5850-4790-a799-ea5357f4b827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:58.967304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe3a7-5850-4790-a799-ea5357f4b827 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:58.969630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89026a3-042d-43ce-9cf0-9ecd8bd3c8b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:58.971221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89026a3-042d-43ce-9cf0-9ecd8bd3c8b2 service swift] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:58.991888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1083/2154] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:45:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:58.992902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89026a3-042d-43ce-9cf0-9ecd8bd3c8b2 service swift] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:58.998051 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1072/2155] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:58 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:59.011190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89026a3-042d-43ce-9cf0-9ecd8bd3c8b2 service swift] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:59.017785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad7179-443e-46aa-bb46-b65220dbfdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:59.018682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad7179-443e-46aa-bb46-b65220dbfdaf admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:59.018957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad7179-443e-46aa-bb46-b65220dbfdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:59.019226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad7179-443e-46aa-bb46-b65220dbfdaf admin admin] PATH_INFO: `/v3/projects/eaeec27d86324d58b9981a40e767ad01/users/ed612cd5e3b14548b409c5cee2edf680/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:59.036230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad7179-443e-46aa-bb46-b65220dbfdaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaeec27d86324d58b9981a40e767ad01, user_id=ed612cd5e3b14548b409c5cee2edf680, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:59.039361 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad7179-443e-46aa-bb46-b65220dbfdaf admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:59.157973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1084/2156] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:45:58 2021] PUT /identity/v3/projects/eaeec27d86324d58b9981a40e767ad01/users/ed612cd5e3b14548b409c5cee2edf680/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:59.173311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687a4da-ffe6-4527-ad07-fe417603fbc1 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:59.173871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687a4da-ffe6-4527-ad07-fe417603fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:59.174586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687a4da-ffe6-4527-ad07-fe417603fbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:59.207896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e687a4da-ffe6-4527-ad07-fe417603fbc1 None None] MFA Rules not processed for user `ed612cd5e3b14548b409c5cee2edf680`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:59.209343 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e687a4da-ffe6-4527-ad07-fe417603fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:59.323825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1073/2157] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:45:59 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:59.327936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad7179-443e-46aa-bb46-b65220dbfdaf admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:59.483654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad7179-443e-46aa-bb46-b65220dbfdaf admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:59.506145 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db080269-68df-4a4b-86eb-9185bb337a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:59.508036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db080269-68df-4a4b-86eb-9185bb337a12 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:59.508781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db080269-68df-4a4b-86eb-9185bb337a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:59.509071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db080269-68df-4a4b-86eb-9185bb337a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:59.512602 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db080269-68df-4a4b-86eb-9185bb337a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:59.522631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db080269-68df-4a4b-86eb-9185bb337a12 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:59.687949 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1085/2158] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:45:59 2021] POST /identity/v3/projects => generated 369 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:59.701048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687a4da-ffe6-4527-ad07-fe417603fbc1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:59.725999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687a4da-ffe6-4527-ad07-fe417603fbc1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:59.848107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73655448-247d-45a5-9d99-4541c03b268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:59.848997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73655448-247d-45a5-9d99-4541c03b268f admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:59.849284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73655448-247d-45a5-9d99-4541c03b268f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:59.849562 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73655448-247d-45a5-9d99-4541c03b268f admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:59.850347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73655448-247d-45a5-9d99-4541c03b268f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:59.852534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73655448-247d-45a5-9d99-4541c03b268f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:59.957557 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1074/2159] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:45:59 2021] POST /identity/v3/users => generated 291 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:59.961756 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db080269-68df-4a4b-86eb-9185bb337a12 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:59.982199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db080269-68df-4a4b-86eb-9185bb337a12 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:59.990003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ac9f0-b068-41b6-8204-d14df6feabd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:59.990799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac9f0-b068-41b6-8204-d14df6feabd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:59.991176 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac9f0-b068-41b6-8204-d14df6feabd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:59.991546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac9f0-b068-41b6-8204-d14df6feabd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:59.992404 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ac9f0-b068-41b6-8204-d14df6feabd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:59.994110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ac9f0-b068-41b6-8204-d14df6feabd2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:00.020777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1086/2160] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:45:59 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:00.024514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73655448-247d-45a5-9d99-4541c03b268f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:00.037594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73655448-247d-45a5-9d99-4541c03b268f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:00.057173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de4110-43b5-4262-816d-f538b726ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:00.060963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de4110-43b5-4262-816d-f538b726ccd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.061486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de4110-43b5-4262-816d-f538b726ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.061977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de4110-43b5-4262-816d-f538b726ccd7 admin admin] PATH_INFO: `/v3/projects/2d369a0b5b994a12ae9f9159205bb32e/users/f510708dde7d411da474955fc4678735/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.111582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de4110-43b5-4262-816d-f538b726ccd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d369a0b5b994a12ae9f9159205bb32e, user_id=f510708dde7d411da474955fc4678735, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:00.114751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de4110-43b5-4262-816d-f538b726ccd7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:00.140904 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d176-6aa2-4aa7-9ff6-1c9937117187 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.141190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d176-6aa2-4aa7-9ff6-1c9937117187 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.141465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d176-6aa2-4aa7-9ff6-1c9937117187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.161233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7ab2d176-6aa2-4aa7-9ff6-1c9937117187 None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:00.162455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7ab2d176-6aa2-4aa7-9ff6-1c9937117187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:00.207064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1075/2161] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:00 2021] PUT /identity/v3/projects/2d369a0b5b994a12ae9f9159205bb32e/users/f510708dde7d411da474955fc4678735/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:00.211321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de4110-43b5-4262-816d-f538b726ccd7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:00.269993 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1087/2162] 10.222.0.25 () {58 vars in 968 bytes} [Fri Aug 27 04:46:00 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:00.289557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2d176-6aa2-4aa7-9ff6-1c9937117187 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:00.335155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de4110-43b5-4262-816d-f538b726ccd7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:00.343132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f69b3e-6eaa-4c4e-92a2-a489ad6a58dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:00.344197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f69b3e-6eaa-4c4e-92a2-a489ad6a58dc admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.344982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f69b3e-6eaa-4c4e-92a2-a489ad6a58dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.345498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f69b3e-6eaa-4c4e-92a2-a489ad6a58dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.346507 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f69b3e-6eaa-4c4e-92a2-a489ad6a58dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:00.348622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f69b3e-6eaa-4c4e-92a2-a489ad6a58dc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:00.364819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1076/2163] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:00 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:00.368914 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f69b3e-6eaa-4c4e-92a2-a489ad6a58dc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:00.381785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f69b3e-6eaa-4c4e-92a2-a489ad6a58dc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:00.385623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2d176-6aa2-4aa7-9ff6-1c9937117187 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:00.391270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02d4b8-aaeb-4563-a3f0-1641aeb18668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:00.392232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d4b8-aaeb-4563-a3f0-1641aeb18668 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.392553 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d4b8-aaeb-4563-a3f0-1641aeb18668 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.398437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d4b8-aaeb-4563-a3f0-1641aeb18668 admin admin] PATH_INFO: `/v3/projects/2d369a0b5b994a12ae9f9159205bb32e/users/f510708dde7d411da474955fc4678735/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.398755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02d4b8-aaeb-4563-a3f0-1641aeb18668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d369a0b5b994a12ae9f9159205bb32e, user_id=f510708dde7d411da474955fc4678735, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:00.403307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02d4b8-aaeb-4563-a3f0-1641aeb18668 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:00.418575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1077/2164] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:00 2021] PUT /identity/v3/projects/2d369a0b5b994a12ae9f9159205bb32e/users/f510708dde7d411da474955fc4678735/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:00.430816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e79fba-426c-4e17-9e55-4afaab8b3a6d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.431371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e79fba-426c-4e17-9e55-4afaab8b3a6d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.431822 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e79fba-426c-4e17-9e55-4afaab8b3a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.473799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f8e79fba-426c-4e17-9e55-4afaab8b3a6d None None] MFA Rules not processed for user `f510708dde7d411da474955fc4678735`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:00.475206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f8e79fba-426c-4e17-9e55-4afaab8b3a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:00.482026 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccac3f-164c-4613-a8b2-9749e61c306a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:00.482799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccac3f-164c-4613-a8b2-9749e61c306a service swift] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.483240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccac3f-164c-4613-a8b2-9749e61c306a service swift] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.485826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccac3f-164c-4613-a8b2-9749e61c306a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.570009 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccac3f-164c-4613-a8b2-9749e61c306a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:00.573802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccac3f-164c-4613-a8b2-9749e61c306a service swift] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:00.588457 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1088/2165] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:46:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:46:00.594929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1078/2166] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:00 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:00.616001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccac3f-164c-4613-a8b2-9749e61c306a service swift] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:00.616001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-02ccac3f-164c-4613-a8b2-9749e61c306a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:00.680499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccac3f-164c-4613-a8b2-9749e61c306a service swift] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:00.748796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80974406-29fd-4797-9b90-3090de590c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:00.749545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80974406-29fd-4797-9b90-3090de590c63 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.749900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80974406-29fd-4797-9b90-3090de590c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.750296 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80974406-29fd-4797-9b90-3090de590c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.760224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80974406-29fd-4797-9b90-3090de590c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:00.761878 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80974406-29fd-4797-9b90-3090de590c63 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:00.777352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1089/2167] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:00 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:00.921247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e79fba-426c-4e17-9e55-4afaab8b3a6d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:00.933819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e79fba-426c-4e17-9e55-4afaab8b3a6d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:00.956592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66a20-207b-4678-8675-44c77c6fee2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:00.956592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66a20-207b-4678-8675-44c77c6fee2c service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.956592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66a20-207b-4678-8675-44c77c6fee2c service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.956592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66a20-207b-4678-8675-44c77c6fee2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:01.096335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc66a20-207b-4678-8675-44c77c6fee2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:01.101610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc66a20-207b-4678-8675-44c77c6fee2c service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:01.110635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1079/2168] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:00 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:03.715189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80974406-29fd-4797-9b90-3090de590c63 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:03.725664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80974406-29fd-4797-9b90-3090de590c63 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:03.730404 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76455d-b130-458d-b8d3-96842b6db25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:03.731421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76455d-b130-458d-b8d3-96842b6db25e service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.731917 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76455d-b130-458d-b8d3-96842b6db25e service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.732437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76455d-b130-458d-b8d3-96842b6db25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:03.734865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-cc76455d-b130-458d-b8d3-96842b6db25e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:03.813956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76455d-b130-458d-b8d3-96842b6db25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:03.815772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76455d-b130-458d-b8d3-96842b6db25e service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:03.838819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1090/2169] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:03 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:04.025896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ae756-0431-4b25-b9a3-cd98ce0f9677 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:04.026447 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ae756-0431-4b25-b9a3-cd98ce0f9677 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:04.027155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ae756-0431-4b25-b9a3-cd98ce0f9677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:04.065696 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-934ae756-0431-4b25-b9a3-cd98ce0f9677 None None] MFA Rules not processed for user `ead952b423654531ac06e9ddb3c693b3`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:04.068468 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-934ae756-0431-4b25-b9a3-cd98ce0f9677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:04.145098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1080/2170] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:04 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:04.157793 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76455d-b130-458d-b8d3-96842b6db25e service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:04.159225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-cc76455d-b130-458d-b8d3-96842b6db25e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:04.233498 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76455d-b130-458d-b8d3-96842b6db25e service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:04.239404 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81234e23-b783-407f-a40e-ddb739443128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:04.240003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81234e23-b783-407f-a40e-ddb739443128 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:04.240287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81234e23-b783-407f-a40e-ddb739443128 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:04.240592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81234e23-b783-407f-a40e-ddb739443128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:04.242357 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-81234e23-b783-407f-a40e-ddb739443128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:04.299258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81234e23-b783-407f-a40e-ddb739443128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:04.300896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81234e23-b783-407f-a40e-ddb739443128 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:04.310279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1091/2171] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:04 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:06.319170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ae756-0431-4b25-b9a3-cd98ce0f9677 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:06.321171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-934ae756-0431-4b25-b9a3-cd98ce0f9677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:06.430031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ae756-0431-4b25-b9a3-cd98ce0f9677 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:06.436124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:06.437276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:06.437571 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:06.437850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] PATH_INFO: `/v3/users/2393ef84bc4144d5a44300cd98c55f6e` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:06.439185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2393ef84bc4144d5a44300cd98c55f6e)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:06.441196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:06.726665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2393ef84bc4144d5a44300cd98c55f6e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:06.758154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2393ef84bc4144d5a44300cd98c55f6e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:06.759282 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2393ef84bc4144d5a44300cd98c55f6e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:06.770330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2393ef84bc4144d5a44300cd98c55f6e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:06.878847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2393ef84bc4144d5a44300cd98c55f6e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:06.890266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1081/2172] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:06 2021] DELETE /identity/v3/users/2393ef84bc4144d5a44300cd98c55f6e => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:06.892075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d89f1-d28d-4ec6-b5b0-296561e9dd7d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:06.892560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d89f1-d28d-4ec6-b5b0-296561e9dd7d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:06.892728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d89f1-d28d-4ec6-b5b0-296561e9dd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:06.920034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-4a0d89f1-d28d-4ec6-b5b0-296561e9dd7d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:06.921293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4a0d89f1-d28d-4ec6-b5b0-296561e9dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:07.059251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:07.078833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1092/2173] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:07.078956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:07.179705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945d566-5de5-4a60-b474-a6187ec4d34c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:07.184640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5576d10-01ec-4652-9de4-4a968cbd2250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:07.185399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5576d10-01ec-4652-9de4-4a968cbd2250 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:07.185815 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5576d10-01ec-4652-9de4-4a968cbd2250 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:07.186181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5576d10-01ec-4652-9de4-4a968cbd2250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:07.197431 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5576d10-01ec-4652-9de4-4a968cbd2250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:07.199461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5576d10-01ec-4652-9de4-4a968cbd2250 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:07.210970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1082/2174] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:46:07.565664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d89f1-d28d-4ec6-b5b0-296561e9dd7d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:07.567117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4a0d89f1-d28d-4ec6-b5b0-296561e9dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:07.602667 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d89f1-d28d-4ec6-b5b0-296561e9dd7d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:07.615576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:07.617432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:07.623495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:07.623495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] PATH_INFO: `/v3/projects/a105a4a28f9544848cdf60f4e1f9dd6b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:07.623495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a105a4a28f9544848cdf60f4e1f9dd6b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:07.623495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:07.903835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a105a4a28f9544848cdf60f4e1f9dd6b', 'request_id': 'req-eb972893-4c4b-4bea-b16c-2c7169b712ab'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.078397 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a105a4a28f9544848cdf60f4e1f9dd6b', 'request_id': 'req-eb972893-4c4b-4bea-b16c-2c7169b712ab'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.089617 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a105a4a28f9544848cdf60f4e1f9dd6b', 'request_id': 'req-eb972893-4c4b-4bea-b16c-2c7169b712ab'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.112290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] The token cache is being invalidate because project a105a4a28f9544848cdf60f4e1f9dd6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:08.112685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.114163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb972893-4c4b-4bea-b16c-2c7169b712ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.116719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1093/2175] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:07 2021] DELETE /identity/v3/projects/a105a4a28f9544848cdf60f4e1f9dd6b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:08.123283 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a77e7-c6f2-47a0-b0f0-1105a43f6bad None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.125679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a77e7-c6f2-47a0-b0f0-1105a43f6bad None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.125679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a77e7-c6f2-47a0-b0f0-1105a43f6bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.147714 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ac5a77e7-c6f2-47a0-b0f0-1105a43f6bad None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:08.152704 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ac5a77e7-c6f2-47a0-b0f0-1105a43f6bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:08.234849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1083/2176] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:08.244861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a863d-6a4f-4e9c-ae85-b6b074611c2c None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.245421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a863d-6a4f-4e9c-ae85-b6b074611c2c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.245971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a863d-6a4f-4e9c-ae85-b6b074611c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.277351 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-ff7a863d-6a4f-4e9c-ae85-b6b074611c2c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:08.279326 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ff7a863d-6a4f-4e9c-ae85-b6b074611c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:08.291903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1094/2177] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:08.298013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a77e7-c6f2-47a0-b0f0-1105a43f6bad None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:08.309647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a77e7-c6f2-47a0-b0f0-1105a43f6bad None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:08.337170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10354cc1-47ef-49c3-8ce4-a59bfce832b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:08.337832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10354cc1-47ef-49c3-8ce4-a59bfce832b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.338122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10354cc1-47ef-49c3-8ce4-a59bfce832b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.338397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10354cc1-47ef-49c3-8ce4-a59bfce832b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.340065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10354cc1-47ef-49c3-8ce4-a59bfce832b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:08.340551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10354cc1-47ef-49c3-8ce4-a59bfce832b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:08.342367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10354cc1-47ef-49c3-8ce4-a59bfce832b7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:08.355644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1084/2178] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:46:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:08.360105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a863d-6a4f-4e9c-ae85-b6b074611c2c None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:08.370163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a863d-6a4f-4e9c-ae85-b6b074611c2c None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:08.377180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c31dc-b7b8-4cfb-afca-06f58d9b464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:08.380261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c31dc-b7b8-4cfb-afca-06f58d9b464f admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.380680 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c31dc-b7b8-4cfb-afca-06f58d9b464f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.382598 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c31dc-b7b8-4cfb-afca-06f58d9b464f admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.383495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c31dc-b7b8-4cfb-afca-06f58d9b464f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:08.385674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c31dc-b7b8-4cfb-afca-06f58d9b464f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:08.439203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10354cc1-47ef-49c3-8ce4-a59bfce832b7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:08.441156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-10354cc1-47ef-49c3-8ce4-a59bfce832b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:08.456933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10354cc1-47ef-49c3-8ce4-a59bfce832b7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:08.461943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:08.463064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.463442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.463811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] PATH_INFO: `/v3/users/ed612cd5e3b14548b409c5cee2edf680` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.465511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed612cd5e3b14548b409c5cee2edf680)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:08.467629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:08.520164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1095/2179] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:46:08 2021] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:08.521363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c31dc-b7b8-4cfb-afca-06f58d9b464f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:08.584976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c31dc-b7b8-4cfb-afca-06f58d9b464f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:08.591858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4d590-1613-4f58-9dab-d9b7fbcaaa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:08.591858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4d590-1613-4f58-9dab-d9b7fbcaaa09 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.591858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4d590-1613-4f58-9dab-d9b7fbcaaa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.591858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4d590-1613-4f58-9dab-d9b7fbcaaa09 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.592228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4d590-1613-4f58-9dab-d9b7fbcaaa09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:08.595172 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4d590-1613-4f58-9dab-d9b7fbcaaa09 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:08.673726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed612cd5e3b14548b409c5cee2edf680'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.686709 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed612cd5e3b14548b409c5cee2edf680'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.687486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed612cd5e3b14548b409c5cee2edf680'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.694708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed612cd5e3b14548b409c5cee2edf680'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.713051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1096/2180] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:46:08 2021] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:08.717226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4d590-1613-4f58-9dab-d9b7fbcaaa09 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:08.726516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4d590-1613-4f58-9dab-d9b7fbcaaa09 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:08.731715 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5736ee-8a09-4b07-8cee-99e864a6c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:08.732345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5736ee-8a09-4b07-8cee-99e864a6c2fe admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.732659 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5736ee-8a09-4b07-8cee-99e864a6c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.732934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5736ee-8a09-4b07-8cee-99e864a6c2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.733655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5736ee-8a09-4b07-8cee-99e864a6c2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:08.735322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5736ee-8a09-4b07-8cee-99e864a6c2fe admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:08.744899 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1097/2181] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:08 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:08.749192 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5736ee-8a09-4b07-8cee-99e864a6c2fe admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:08.758488 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5736ee-8a09-4b07-8cee-99e864a6c2fe admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:08.763291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364bda8-43cf-45df-8ffa-44bca26e9209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:08.763902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364bda8-43cf-45df-8ffa-44bca26e9209 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.766732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364bda8-43cf-45df-8ffa-44bca26e9209 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.766732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364bda8-43cf-45df-8ffa-44bca26e9209 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.766732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364bda8-43cf-45df-8ffa-44bca26e9209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:08.767034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364bda8-43cf-45df-8ffa-44bca26e9209 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:08.777403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1098/2182] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:08 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:08.781267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364bda8-43cf-45df-8ffa-44bca26e9209 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:08.790890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364bda8-43cf-45df-8ffa-44bca26e9209 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:08.796062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f5601-2fd5-4311-b7f9-2e11a8d6b4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:08.797038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5601-2fd5-4311-b7f9-2e11a8d6b4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.797397 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5601-2fd5-4311-b7f9-2e11a8d6b4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.801329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5601-2fd5-4311-b7f9-2e11a8d6b4dc admin admin] PATH_INFO: `/v3/projects/a5baed1823934de3b988bcab5d60602b/users/7c45970aae3c4a8bb3dade382ec7532c/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.813106 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f5601-2fd5-4311-b7f9-2e11a8d6b4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5baed1823934de3b988bcab5d60602b, user_id=7c45970aae3c4a8bb3dade382ec7532c, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:08.815755 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f5601-2fd5-4311-b7f9-2e11a8d6b4dc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:08.824166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ba086ebf-9475-43c4-9f34-de09cbe2a72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed612cd5e3b14548b409c5cee2edf680'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.833276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1085/2183] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:08 2021] DELETE /identity/v3/users/ed612cd5e3b14548b409c5cee2edf680 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:08.837418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349da0e-c7bf-4a05-9a55-0b0bafdccc18 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.837858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349da0e-c7bf-4a05-9a55-0b0bafdccc18 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.838161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349da0e-c7bf-4a05-9a55-0b0bafdccc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.862929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-5349da0e-c7bf-4a05-9a55-0b0bafdccc18 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:08.865016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5349da0e-c7bf-4a05-9a55-0b0bafdccc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:08.908411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1099/2184] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:08 2021] PUT /identity/v3/projects/a5baed1823934de3b988bcab5d60602b/users/7c45970aae3c4a8bb3dade382ec7532c/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:08.919202 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a69d-15bf-49a1-a817-1456dcaa0d7d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.919490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a69d-15bf-49a1-a817-1456dcaa0d7d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.919765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a69d-15bf-49a1-a817-1456dcaa0d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.926934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1086/2185] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:08.946288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349da0e-c7bf-4a05-9a55-0b0bafdccc18 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:08.949468 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5349da0e-c7bf-4a05-9a55-0b0bafdccc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:08.964486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-4371a69d-15bf-49a1-a817-1456dcaa0d7d None None] MFA Rules not processed for user `7c45970aae3c4a8bb3dade382ec7532c`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:08.965828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4371a69d-15bf-49a1-a817-1456dcaa0d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:09.018847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349da0e-c7bf-4a05-9a55-0b0bafdccc18 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:09.051217 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1100/2186] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:08 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:09.074604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d545a-8d6c-4974-8a10-60a1b9f0e925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:09.075289 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d545a-8d6c-4974-8a10-60a1b9f0e925 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:09.075598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d545a-8d6c-4974-8a10-60a1b9f0e925 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:09.075891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d545a-8d6c-4974-8a10-60a1b9f0e925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:09.135356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d545a-8d6c-4974-8a10-60a1b9f0e925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:09.136882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d545a-8d6c-4974-8a10-60a1b9f0e925 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:09.147004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1087/2187] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:09.517161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371a69d-15bf-49a1-a817-1456dcaa0d7d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:09.519440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4371a69d-15bf-49a1-a817-1456dcaa0d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:09.636613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371a69d-15bf-49a1-a817-1456dcaa0d7d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:09.641150 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff0f7c-92e6-4ba5-a265-7a42163349c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:09.642039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff0f7c-92e6-4ba5-a265-7a42163349c6 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:09.642480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff0f7c-92e6-4ba5-a265-7a42163349c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:09.642968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff0f7c-92e6-4ba5-a265-7a42163349c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:09.656034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff0f7c-92e6-4ba5-a265-7a42163349c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:09.657786 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff0f7c-92e6-4ba5-a265-7a42163349c6 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:09.678156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd32fe-7780-4b1a-9dd6-f92ffdf2d615 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:09.678777 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd32fe-7780-4b1a-9dd6-f92ffdf2d615 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:09.679137 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd32fe-7780-4b1a-9dd6-f92ffdf2d615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:09.705163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-dfdd32fe-7780-4b1a-9dd6-f92ffdf2d615 None None] MFA Rules not processed for user `b5b99e0829e84f2bb0a58e835a1cdc47`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:09.706540 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-dfdd32fe-7780-4b1a-9dd6-f92ffdf2d615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:09.708935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1101/2188] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:09 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:09.864747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff0f7c-92e6-4ba5-a265-7a42163349c6 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:09.864747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-faff0f7c-92e6-4ba5-a265-7a42163349c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:09.895426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff0f7c-92e6-4ba5-a265-7a42163349c6 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:09.902818 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1088/2189] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:09 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 27 04:46:09.903710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd32fe-7780-4b1a-9dd6-f92ffdf2d615 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:09.906042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-dfdd32fe-7780-4b1a-9dd6-f92ffdf2d615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:09.911093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:09.916596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:09.916596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:09.916596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] PATH_INFO: `/v3/users/12937ff90ed14b619205b95743126b9c` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:09.916596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12937ff90ed14b619205b95743126b9c)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:09.916596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:09.922980 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd32fe-7780-4b1a-9dd6-f92ffdf2d615 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:09.928413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:09.929805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:09.930252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:09.930756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] PATH_INFO: `/v3/projects/eaeec27d86324d58b9981a40e767ad01` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:09.932094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaeec27d86324d58b9981a40e767ad01)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:09.934886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:10.185284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaeec27d86324d58b9981a40e767ad01', 'request_id': 'req-3d1997bb-2fd6-4126-8a31-d5750427f851'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.189143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12937ff90ed14b619205b95743126b9c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.190265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12937ff90ed14b619205b95743126b9c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.191236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12937ff90ed14b619205b95743126b9c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.192771 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaeec27d86324d58b9981a40e767ad01', 'request_id': 'req-3d1997bb-2fd6-4126-8a31-d5750427f851'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.199661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaeec27d86324d58b9981a40e767ad01', 'request_id': 'req-3d1997bb-2fd6-4126-8a31-d5750427f851'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.209064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12937ff90ed14b619205b95743126b9c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.336058 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] The token cache is being invalidate because project eaeec27d86324d58b9981a40e767ad01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:10.336429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.337168 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.338734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1089/2190] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:09 2021] DELETE /identity/v3/projects/eaeec27d86324d58b9981a40e767ad01 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:10.342891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:10.344273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:10.450581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1997bb-2fd6-4126-8a31-d5750427f851 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:10.450581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:10.450581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.450581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.451547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] PATH_INFO: `/v3/users/f510708dde7d411da474955fc4678735` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.451547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f510708dde7d411da474955fc4678735)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:10.451547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:10.489885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6c782605-3122-47cb-bacd-07d6dd877c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12937ff90ed14b619205b95743126b9c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.503762 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1102/2191] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:09 2021] DELETE /identity/v3/users/12937ff90ed14b619205b95743126b9c => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:10.508439 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73786745-bcf4-440f-862b-b00bc1e9927b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.508731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73786745-bcf4-440f-862b-b00bc1e9927b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.509008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73786745-bcf4-440f-862b-b00bc1e9927b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.526069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-73786745-bcf4-440f-862b-b00bc1e9927b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:10.532081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-73786745-bcf4-440f-862b-b00bc1e9927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:10.602668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1103/2192] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:10.615543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73786745-bcf4-440f-862b-b00bc1e9927b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:10.617620 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-73786745-bcf4-440f-862b-b00bc1e9927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:10.709302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73786745-bcf4-440f-862b-b00bc1e9927b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:10.739249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f510708dde7d411da474955fc4678735'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.748146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790205e8-c68c-489d-944a-e54ed46f2be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:10.749412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790205e8-c68c-489d-944a-e54ed46f2be7 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.749850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790205e8-c68c-489d-944a-e54ed46f2be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.750414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790205e8-c68c-489d-944a-e54ed46f2be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.783108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790205e8-c68c-489d-944a-e54ed46f2be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:10.783108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790205e8-c68c-489d-944a-e54ed46f2be7 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:10.783532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f510708dde7d411da474955fc4678735'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.783532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f510708dde7d411da474955fc4678735'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.793581 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1104/2193] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:10.806214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f510708dde7d411da474955fc4678735'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.968019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f510708dde7d411da474955fc4678735'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.982152 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1090/2194] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:10 2021] DELETE /identity/v3/users/f510708dde7d411da474955fc4678735 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:11.480482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790205e8-c68c-489d-944a-e54ed46f2be7 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:11.481931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-790205e8-c68c-489d-944a-e54ed46f2be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:11.499483 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790205e8-c68c-489d-944a-e54ed46f2be7 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:11.597672 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.598636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.598997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.599346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] PATH_INFO: `/v3/projects/5066cda710174cba89b81095bbff2192` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.600786 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5066cda710174cba89b81095bbff2192)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.602981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.698841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5066cda710174cba89b81095bbff2192', 'request_id': 'req-2517d523-83e3-4778-b57f-fc22dd63faa4'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:11.727189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:11.732584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:11.763304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609d64a-ef90-4c0a-a8db-d191a38ebfc7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:11.822110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.822840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.823124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.823932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] PATH_INFO: `/v3/projects/2d369a0b5b994a12ae9f9159205bb32e` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.825203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d369a0b5b994a12ae9f9159205bb32e)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.827126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5066cda710174cba89b81095bbff2192', 'request_id': 'req-2517d523-83e3-4778-b57f-fc22dd63faa4'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:11.827247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.835294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5066cda710174cba89b81095bbff2192', 'request_id': 'req-2517d523-83e3-4778-b57f-fc22dd63faa4'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:11.849360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] The token cache is being invalidate because project 5066cda710174cba89b81095bbff2192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:11.849900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:11.850796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:11.853426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1105/2195] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:11 2021] DELETE /identity/v3/projects/5066cda710174cba89b81095bbff2192 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:11.860034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:11.861780 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:11.875473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517d523-83e3-4778-b57f-fc22dd63faa4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:11.882231 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.883124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.883409 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.883688 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] PATH_INFO: `/v3/users/81e3d8c73cf14db9b40f586b509c618b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.885054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e3d8c73cf14db9b40f586b509c618b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.887602 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.954587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d369a0b5b994a12ae9f9159205bb32e', 'request_id': 'req-9117546b-9750-4500-b662-2e969385ac5d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:11.960604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d369a0b5b994a12ae9f9159205bb32e', 'request_id': 'req-9117546b-9750-4500-b662-2e969385ac5d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:11.966988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d369a0b5b994a12ae9f9159205bb32e', 'request_id': 'req-9117546b-9750-4500-b662-2e969385ac5d'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.037706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] The token cache is being invalidate because project 2d369a0b5b994a12ae9f9159205bb32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:12.037996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.038619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9117546b-9750-4500-b662-2e969385ac5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.040232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1091/2196] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:11 2021] DELETE /identity/v3/projects/2d369a0b5b994a12ae9f9159205bb32e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:12.046091 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7645d-ba11-4dd3-8da3-e7e38099fa69 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.046434 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7645d-ba11-4dd3-8da3-e7e38099fa69 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.046717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7645d-ba11-4dd3-8da3-e7e38099fa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.066331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4aa7645d-ba11-4dd3-8da3-e7e38099fa69 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:12.067570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4aa7645d-ba11-4dd3-8da3-e7e38099fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.115341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e3d8c73cf14db9b40f586b509c618b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.116640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e3d8c73cf14db9b40f586b509c618b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.117635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e3d8c73cf14db9b40f586b509c618b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.132547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1092/2197] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:12.134481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba0bb-4b50-46f7-8169-b64ac4b432e0 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.135877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba0bb-4b50-46f7-8169-b64ac4b432e0 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.139431 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba0bb-4b50-46f7-8169-b64ac4b432e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.143456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e3d8c73cf14db9b40f586b509c618b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.155444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-8b7ba0bb-4b50-46f7-8169-b64ac4b432e0 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:12.156712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8b7ba0bb-4b50-46f7-8169-b64ac4b432e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.165109 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1093/2198] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:12.170152 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ba0bb-4b50-46f7-8169-b64ac4b432e0 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.179193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ba0bb-4b50-46f7-8169-b64ac4b432e0 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.184990 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7c1f4-ce33-4f48-851d-c50f5407d280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.185691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7c1f4-ce33-4f48-851d-c50f5407d280 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.185983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7c1f4-ce33-4f48-851d-c50f5407d280 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.186262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7c1f4-ce33-4f48-851d-c50f5407d280 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.186985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7c1f4-ce33-4f48-851d-c50f5407d280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:12.187323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7c1f4-ce33-4f48-851d-c50f5407d280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.188956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7c1f4-ce33-4f48-851d-c50f5407d280 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.202002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1094/2199] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:46:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:46:12.206615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7c1f4-ce33-4f48-851d-c50f5407d280 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.215262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e3d8c73cf14db9b40f586b509c618b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.216696 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7c1f4-ce33-4f48-851d-c50f5407d280 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.223073 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382559-9245-4900-864b-f08a9c8fc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.223677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382559-9245-4900-864b-f08a9c8fc2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.223961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382559-9245-4900-864b-f08a9c8fc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.224240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382559-9245-4900-864b-f08a9c8fc2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.224978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a382559-9245-4900-864b-f08a9c8fc2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.226973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a382559-9245-4900-864b-f08a9c8fc2f4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.230338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1106/2200] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:11 2021] DELETE /identity/v3/users/81e3d8c73cf14db9b40f586b509c618b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:12.320951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1095/2201] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:46:12 2021] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:12.326027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.386579 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b30d6-2cf9-4808-9b9e-d3b6205febc3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.447480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696170a-4735-46ed-961e-f5ffdc69fe90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.448151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696170a-4735-46ed-961e-f5ffdc69fe90 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.448494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696170a-4735-46ed-961e-f5ffdc69fe90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.448779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696170a-4735-46ed-961e-f5ffdc69fe90 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.449457 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696170a-4735-46ed-961e-f5ffdc69fe90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.451367 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696170a-4735-46ed-961e-f5ffdc69fe90 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.544480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1107/2202] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:46:12 2021] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:12.553639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382559-9245-4900-864b-f08a9c8fc2f4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.563070 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382559-9245-4900-864b-f08a9c8fc2f4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.570071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1818e-9510-437a-bc4d-f7bdf08de57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.571058 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1818e-9510-437a-bc4d-f7bdf08de57f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.571492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1818e-9510-437a-bc4d-f7bdf08de57f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.571916 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1818e-9510-437a-bc4d-f7bdf08de57f admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.573105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1818e-9510-437a-bc4d-f7bdf08de57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.575705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1818e-9510-437a-bc4d-f7bdf08de57f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.588237 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1096/2203] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:12 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:12.599122 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696170a-4735-46ed-961e-f5ffdc69fe90 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.609905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696170a-4735-46ed-961e-f5ffdc69fe90 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.614660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4d6a5-2f04-4566-8b25-12fe8b90261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.615344 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4d6a5-2f04-4566-8b25-12fe8b90261e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.615766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4d6a5-2f04-4566-8b25-12fe8b90261e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.616046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4d6a5-2f04-4566-8b25-12fe8b90261e admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.616857 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4d6a5-2f04-4566-8b25-12fe8b90261e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.618461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4d6a5-2f04-4566-8b25-12fe8b90261e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.632788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1108/2204] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:12 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:12.634335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1818e-9510-437a-bc4d-f7bdf08de57f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.644877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1818e-9510-437a-bc4d-f7bdf08de57f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.649479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6528aa-19c9-44b3-84cf-b526a98af94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.650344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6528aa-19c9-44b3-84cf-b526a98af94d admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.653799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6528aa-19c9-44b3-84cf-b526a98af94d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.653799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6528aa-19c9-44b3-84cf-b526a98af94d admin admin] PATH_INFO: `/v3/projects/9be2f15d7c1a43d39c103dc53a306662/users/12f6af17d42b4c7b84ff33616f73c344/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.665119 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6528aa-19c9-44b3-84cf-b526a98af94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be2f15d7c1a43d39c103dc53a306662, user_id=12f6af17d42b4c7b84ff33616f73c344, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.668261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6528aa-19c9-44b3-84cf-b526a98af94d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.708338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4d6a5-2f04-4566-8b25-12fe8b90261e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.711261 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8ff4d6a5-2f04-4566-8b25-12fe8b90261e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.726044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4d6a5-2f04-4566-8b25-12fe8b90261e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.732552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.733422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.733698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.733980 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] PATH_INFO: `/v3/projects/d6eb7e11005b4fc6bc2c52cb2ff20121` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.735331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6eb7e11005b4fc6bc2c52cb2ff20121)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.737225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.765908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1097/2205] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:12 2021] PUT /identity/v3/projects/9be2f15d7c1a43d39c103dc53a306662/users/12f6af17d42b4c7b84ff33616f73c344/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:12.777625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262d863-85c7-47ae-9e4f-c3893e95e8ae None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.777919 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262d863-85c7-47ae-9e4f-c3893e95e8ae None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.778207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262d863-85c7-47ae-9e4f-c3893e95e8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.806005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b262d863-85c7-47ae-9e4f-c3893e95e8ae None None] MFA Rules not processed for user `12f6af17d42b4c7b84ff33616f73c344`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:12.807251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b262d863-85c7-47ae-9e4f-c3893e95e8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.867978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6eb7e11005b4fc6bc2c52cb2ff20121', 'request_id': 'req-34dc1743-9c92-46d4-b316-7947b58e8e5a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.874182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1098/2206] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:12 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:12.879005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262d863-85c7-47ae-9e4f-c3893e95e8ae None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.946714 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6eb7e11005b4fc6bc2c52cb2ff20121', 'request_id': 'req-34dc1743-9c92-46d4-b316-7947b58e8e5a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.947885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262d863-85c7-47ae-9e4f-c3893e95e8ae None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.953321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6eb7e11005b4fc6bc2c52cb2ff20121', 'request_id': 'req-34dc1743-9c92-46d4-b316-7947b58e8e5a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.967017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] The token cache is being invalidate because project d6eb7e11005b4fc6bc2c52cb2ff20121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:12.967687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.968654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.970423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1109/2207] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:12 2021] DELETE /identity/v3/projects/d6eb7e11005b4fc6bc2c52cb2ff20121 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:12.975525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.977134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:13.015437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483b39b-3c28-4141-bfb5-995e092ff6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.017558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483b39b-3c28-4141-bfb5-995e092ff6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.017978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483b39b-3c28-4141-bfb5-995e092ff6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.018356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483b39b-3c28-4141-bfb5-995e092ff6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.019610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483b39b-3c28-4141-bfb5-995e092ff6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.022561 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483b39b-3c28-4141-bfb5-995e092ff6a1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.054220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1743-9c92-46d4-b316-7947b58e8e5a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.058915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.059803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.060088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.060385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] PATH_INFO: `/v3/users/014b3bc91599476fbd07a05f121b875d` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.061651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=014b3bc91599476fbd07a05f121b875d)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.063592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.143936 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1099/2208] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:46:12 2021] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:13.148006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483b39b-3c28-4141-bfb5-995e092ff6a1 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.149814 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d483b39b-3c28-4141-bfb5-995e092ff6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:13.224410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483b39b-3c28-4141-bfb5-995e092ff6a1 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.229514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432b291-2a2d-44c4-9fd0-5a241d33ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.230182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432b291-2a2d-44c4-9fd0-5a241d33ec9d admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.230464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432b291-2a2d-44c4-9fd0-5a241d33ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.230738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432b291-2a2d-44c4-9fd0-5a241d33ec9d admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.231459 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432b291-2a2d-44c4-9fd0-5a241d33ec9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.233675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432b291-2a2d-44c4-9fd0-5a241d33ec9d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.276443 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014b3bc91599476fbd07a05f121b875d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:13.277635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014b3bc91599476fbd07a05f121b875d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:13.278274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014b3bc91599476fbd07a05f121b875d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:13.295144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014b3bc91599476fbd07a05f121b875d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:13.349588 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1100/2209] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:46:13 2021] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:13.350942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432b291-2a2d-44c4-9fd0-5a241d33ec9d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.352764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f432b291-2a2d-44c4-9fd0-5a241d33ec9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:13.366495 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432b291-2a2d-44c4-9fd0-5a241d33ec9d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.368159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014b3bc91599476fbd07a05f121b875d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:13.377338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07a02f-c1c1-4029-827f-523e986510bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.378107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07a02f-c1c1-4029-827f-523e986510bb admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.378402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07a02f-c1c1-4029-827f-523e986510bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.378679 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07a02f-c1c1-4029-827f-523e986510bb admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.379419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07a02f-c1c1-4029-827f-523e986510bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.381070 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07a02f-c1c1-4029-827f-523e986510bb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.388440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1110/2210] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:12 2021] DELETE /identity/v3/users/014b3bc91599476fbd07a05f121b875d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:13.395313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1101/2211] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:13 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:13.396833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.463022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8054650-2927-4c70-805e-cfa56d8289ae admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.469018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c4be5-f406-4e63-9798-4725de4e897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.470309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c4be5-f406-4e63-9798-4725de4e897a admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.470831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c4be5-f406-4e63-9798-4725de4e897a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.471180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c4be5-f406-4e63-9798-4725de4e897a admin admin] PATH_INFO: `/v3/projects/c83d526bede447cab37ce8892989ce74/users/ff0136b408e343d198950c3792e3f019/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.492618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c4be5-f406-4e63-9798-4725de4e897a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83d526bede447cab37ce8892989ce74, user_id=ff0136b408e343d198950c3792e3f019, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.495620 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c4be5-f406-4e63-9798-4725de4e897a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.586694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1111/2212] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:13 2021] PUT /identity/v3/projects/c83d526bede447cab37ce8892989ce74/users/ff0136b408e343d198950c3792e3f019/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:13.590836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07a02f-c1c1-4029-827f-523e986510bb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.601407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07a02f-c1c1-4029-827f-523e986510bb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.658699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9f001-e43c-446c-a1c2-46114f568e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.659405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f001-e43c-446c-a1c2-46114f568e6e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.659686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f001-e43c-446c-a1c2-46114f568e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.659962 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f001-e43c-446c-a1c2-46114f568e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.660717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9f001-e43c-446c-a1c2-46114f568e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.662296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9f001-e43c-446c-a1c2-46114f568e6e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.671997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1102/2213] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:13 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:13.676200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c4be5-f406-4e63-9798-4725de4e897a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.687915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c4be5-f406-4e63-9798-4725de4e897a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.694403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06848ca7-b992-475a-bac8-60e735ad32e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.695307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06848ca7-b992-475a-bac8-60e735ad32e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.695586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06848ca7-b992-475a-bac8-60e735ad32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.695863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06848ca7-b992-475a-bac8-60e735ad32e9 admin admin] PATH_INFO: `/v3/projects/c83d526bede447cab37ce8892989ce74/users/ff0136b408e343d198950c3792e3f019/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.698921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06848ca7-b992-475a-bac8-60e735ad32e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83d526bede447cab37ce8892989ce74, user_id=ff0136b408e343d198950c3792e3f019, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.702178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06848ca7-b992-475a-bac8-60e735ad32e9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.713835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1112/2214] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:13 2021] PUT /identity/v3/projects/c83d526bede447cab37ce8892989ce74/users/ff0136b408e343d198950c3792e3f019/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:13.726341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f03c4-8ae5-4d9f-857f-9922d499e558 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.726633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f03c4-8ae5-4d9f-857f-9922d499e558 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.726907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f03c4-8ae5-4d9f-857f-9922d499e558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.755382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-067f03c4-8ae5-4d9f-857f-9922d499e558 None None] MFA Rules not processed for user `ff0136b408e343d198950c3792e3f019`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:13.756827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-067f03c4-8ae5-4d9f-857f-9922d499e558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:13.833128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1103/2215] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:13 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:13.843908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06848ca7-b992-475a-bac8-60e735ad32e9 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.845678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-06848ca7-b992-475a-bac8-60e735ad32e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:13.912567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06848ca7-b992-475a-bac8-60e735ad32e9 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.916673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f03c4-8ae5-4d9f-857f-9922d499e558 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.917599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393decb6-6dc9-4ea5-9441-f6feab245a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.918258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393decb6-6dc9-4ea5-9441-f6feab245a53 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.918544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393decb6-6dc9-4ea5-9441-f6feab245a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.918830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393decb6-6dc9-4ea5-9441-f6feab245a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.919845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-067f03c4-8ae5-4d9f-857f-9922d499e558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:13.931329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393decb6-6dc9-4ea5-9441-f6feab245a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.932313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393decb6-6dc9-4ea5-9441-f6feab245a53 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.944668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1113/2216] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:13 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:13.971480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393decb6-6dc9-4ea5-9441-f6feab245a53 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:14.000013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f03c4-8ae5-4d9f-857f-9922d499e558 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.005018 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.005966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.006317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.006660 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] PATH_INFO: `/v3/projects/828f18e8ad0f437f9c3051170bce05ff` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.007855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=828f18e8ad0f437f9c3051170bce05ff)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.009796 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.034010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393decb6-6dc9-4ea5-9441-f6feab245a53 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.039679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.044059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.045553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.045553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] PATH_INFO: `/v3/users/12f6af17d42b4c7b84ff33616f73c344` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.045924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f6af17d42b4c7b84ff33616f73c344)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.047858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.143093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828f18e8ad0f437f9c3051170bce05ff', 'request_id': 'req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:14.146970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828f18e8ad0f437f9c3051170bce05ff', 'request_id': 'req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:14.152697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828f18e8ad0f437f9c3051170bce05ff', 'request_id': 'req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:14.215315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] The token cache is being invalidate because project 828f18e8ad0f437f9c3051170bce05ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:14.215625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:14.216280 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2adc8cc5-acc1-4b71-b0e0-9b4a5590d328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:14.217866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1104/2217] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:13 2021] DELETE /identity/v3/projects/828f18e8ad0f437f9c3051170bce05ff => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:14.224512 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f847d-18c6-4f74-a008-7bd7801a7aa0 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.224806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f847d-18c6-4f74-a008-7bd7801a7aa0 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.225145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f847d-18c6-4f74-a008-7bd7801a7aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.244339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-679f847d-18c6-4f74-a008-7bd7801a7aa0 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:14.246112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-679f847d-18c6-4f74-a008-7bd7801a7aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:14.280806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f6af17d42b4c7b84ff33616f73c344'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:14.281472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f6af17d42b4c7b84ff33616f73c344'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:14.282151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f6af17d42b4c7b84ff33616f73c344'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:14.294753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f6af17d42b4c7b84ff33616f73c344'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:14.309122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1105/2218] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:14.317707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7c078-9704-4f02-8a3e-cf2c1096c109 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.318006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7c078-9704-4f02-8a3e-cf2c1096c109 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.318271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7c078-9704-4f02-8a3e-cf2c1096c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.336460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-53d7c078-9704-4f02-8a3e-cf2c1096c109 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:14.337669 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-53d7c078-9704-4f02-8a3e-cf2c1096c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:14.346149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1106/2219] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:14.350423 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7c078-9704-4f02-8a3e-cf2c1096c109 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:14.357889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ed990bd8-84a2-47c5-af36-6fa71c1e9aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f6af17d42b4c7b84ff33616f73c344'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:14.360269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7c078-9704-4f02-8a3e-cf2c1096c109 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.365073 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d269d7a-e429-4f14-8e64-08b7e76cdb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.365722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d269d7a-e429-4f14-8e64-08b7e76cdb8f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.366004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d269d7a-e429-4f14-8e64-08b7e76cdb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.366288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d269d7a-e429-4f14-8e64-08b7e76cdb8f admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.367005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d269d7a-e429-4f14-8e64-08b7e76cdb8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:14.367310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d269d7a-e429-4f14-8e64-08b7e76cdb8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.369024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d269d7a-e429-4f14-8e64-08b7e76cdb8f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.374291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1114/2220] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:13 2021] DELETE /identity/v3/users/12f6af17d42b4c7b84ff33616f73c344 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:14.378773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627ee82-aa5c-4275-9d42-8c10a9325ce5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.379069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627ee82-aa5c-4275-9d42-8c10a9325ce5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.379354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627ee82-aa5c-4275-9d42-8c10a9325ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.381373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1107/2221] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:46:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:46:14.385409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d269d7a-e429-4f14-8e64-08b7e76cdb8f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:14.395356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d269d7a-e429-4f14-8e64-08b7e76cdb8f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.397644 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-5627ee82-aa5c-4275-9d42-8c10a9325ce5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:14.398865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5627ee82-aa5c-4275-9d42-8c10a9325ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:14.453716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f59e1-084d-4f0e-b443-e930318b7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.454384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f59e1-084d-4f0e-b443-e930318b7a96 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.454672 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f59e1-084d-4f0e-b443-e930318b7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.454951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f59e1-084d-4f0e-b443-e930318b7a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.455646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f59e1-084d-4f0e-b443-e930318b7a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.457624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f59e1-084d-4f0e-b443-e930318b7a96 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.462111 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1115/2222] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:14.472595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627ee82-aa5c-4275-9d42-8c10a9325ce5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:14.473944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5627ee82-aa5c-4275-9d42-8c10a9325ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:14.536697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627ee82-aa5c-4275-9d42-8c10a9325ce5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.540347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52d393-a7ad-46d9-9730-18c30a97bc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.541021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52d393-a7ad-46d9-9730-18c30a97bc2d service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.541300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52d393-a7ad-46d9-9730-18c30a97bc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.541569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52d393-a7ad-46d9-9730-18c30a97bc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.551808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52d393-a7ad-46d9-9730-18c30a97bc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.553442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52d393-a7ad-46d9-9730-18c30a97bc2d service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.563522 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1108/2223] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:46:14 2021] POST /identity/v3/projects => generated 399 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:14.564230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f59e1-084d-4f0e-b443-e930318b7a96 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:14.565455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1116/2224] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:46:14.638814 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f59e1-084d-4f0e-b443-e930318b7a96 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.645586 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d6365-51f1-47b1-992b-75a8e2874971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.646261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d6365-51f1-47b1-992b-75a8e2874971 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.646543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d6365-51f1-47b1-992b-75a8e2874971 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.646834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d6365-51f1-47b1-992b-75a8e2874971 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.647588 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d6365-51f1-47b1-992b-75a8e2874971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.650010 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d6365-51f1-47b1-992b-75a8e2874971 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.747638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1109/2225] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:46:14 2021] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:14.751668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52d393-a7ad-46d9-9730-18c30a97bc2d service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:14.762524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52d393-a7ad-46d9-9730-18c30a97bc2d service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.767324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f439-87c6-415a-b98e-32c4010475b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.767976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f439-87c6-415a-b98e-32c4010475b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.768262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f439-87c6-415a-b98e-32c4010475b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.768572 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f439-87c6-415a-b98e-32c4010475b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.769302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8f439-87c6-415a-b98e-32c4010475b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.770890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8f439-87c6-415a-b98e-32c4010475b0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.781291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1117/2226] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:14.785345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d6365-51f1-47b1-992b-75a8e2874971 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:14.795170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d6365-51f1-47b1-992b-75a8e2874971 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.799862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42ed92-a17e-4605-8621-40095c139561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.800560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ed92-a17e-4605-8621-40095c139561 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.800848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ed92-a17e-4605-8621-40095c139561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.801129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ed92-a17e-4605-8621-40095c139561 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.801863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42ed92-a17e-4605-8621-40095c139561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.803452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42ed92-a17e-4605-8621-40095c139561 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.817339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1110/2227] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:14 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:14.818560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f439-87c6-415a-b98e-32c4010475b0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:14.848491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f439-87c6-415a-b98e-32c4010475b0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.865592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a5d6c-482f-4218-842d-215b5c4c9c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.866557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a5d6c-482f-4218-842d-215b5c4c9c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.866843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a5d6c-482f-4218-842d-215b5c4c9c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.867151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a5d6c-482f-4218-842d-215b5c4c9c96 admin admin] PATH_INFO: `/v3/projects/76ea3aae3c3c48309d8b899e6f37f055/users/87cecd0b15c6496fbeeaaed4749d59a3/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.885014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a5d6c-482f-4218-842d-215b5c4c9c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ea3aae3c3c48309d8b899e6f37f055, user_id=87cecd0b15c6496fbeeaaed4749d59a3, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.888258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a5d6c-482f-4218-842d-215b5c4c9c96 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:15.010040 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1118/2228] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:14 2021] PUT /identity/v3/projects/76ea3aae3c3c48309d8b899e6f37f055/users/87cecd0b15c6496fbeeaaed4749d59a3/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:15.021799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f52c7-1c43-4df2-a1ec-ec962170f172 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.022322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f52c7-1c43-4df2-a1ec-ec962170f172 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.022409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f52c7-1c43-4df2-a1ec-ec962170f172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.050589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-104f52c7-1c43-4df2-a1ec-ec962170f172 None None] MFA Rules not processed for user `87cecd0b15c6496fbeeaaed4749d59a3`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:15.051717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-104f52c7-1c43-4df2-a1ec-ec962170f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:15.075139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a5d6c-482f-4218-842d-215b5c4c9c96 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:15.077069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-930a5d6c-482f-4218-842d-215b5c4c9c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:15.149402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1111/2229] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:15 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:15.153688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f52c7-1c43-4df2-a1ec-ec962170f172 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:15.181201 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a5d6c-482f-4218-842d-215b5c4c9c96 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:15.187165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:15.188318 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.188746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.189127 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] PATH_INFO: `/v3/projects/9be2f15d7c1a43d39c103dc53a306662` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.190484 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be2f15d7c1a43d39c103dc53a306662)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:15.193176 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:15.243408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f52c7-1c43-4df2-a1ec-ec962170f172 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:15.248614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ce7da-068a-466b-af39-27980ebe8804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:15.249283 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce7da-068a-466b-af39-27980ebe8804 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.249566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce7da-068a-466b-af39-27980ebe8804 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.249840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce7da-068a-466b-af39-27980ebe8804 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.250533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ce7da-068a-466b-af39-27980ebe8804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:15.252481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ce7da-068a-466b-af39-27980ebe8804 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:15.335102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be2f15d7c1a43d39c103dc53a306662', 'request_id': 'req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:15.353743 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1112/2230] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:46:15 2021] POST /identity/v3/projects => generated 401 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:15.357739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ce7da-068a-466b-af39-27980ebe8804 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:15.404035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be2f15d7c1a43d39c103dc53a306662', 'request_id': 'req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:15.409929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be2f15d7c1a43d39c103dc53a306662', 'request_id': 'req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:15.419768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ce7da-068a-466b-af39-27980ebe8804 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:15.421814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] The token cache is being invalidate because project 9be2f15d7c1a43d39c103dc53a306662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:15.422240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:15.423119 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:15.424719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1119/2231] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:15 2021] DELETE /identity/v3/projects/9be2f15d7c1a43d39c103dc53a306662 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:15.425605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4375-97b9-45e3-89ca-38e6d43a4819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:15.426278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4375-97b9-45e3-89ca-38e6d43a4819 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.426563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4375-97b9-45e3-89ca-38e6d43a4819 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.426841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4375-97b9-45e3-89ca-38e6d43a4819 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.427536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a4375-97b9-45e3-89ca-38e6d43a4819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:15.429304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:15.429842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a4375-97b9-45e3-89ca-38e6d43a4819 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:15.431197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:15.501944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c99c-aadc-4bbb-9e5f-6d9476fbc188 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:15.507518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:15.508432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.508716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.508991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] PATH_INFO: `/v3/users/ff0136b408e343d198950c3792e3f019` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.510229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0136b408e343d198950c3792e3f019)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:15.512193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:15.539335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1113/2232] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:46:15 2021] POST /identity/v3/users => generated 307 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:15.541285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4375-97b9-45e3-89ca-38e6d43a4819 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:15.544454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f13a4375-97b9-45e3-89ca-38e6d43a4819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:15.557674 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4375-97b9-45e3-89ca-38e6d43a4819 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:15.563122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc1d0d-8e5d-4b63-a47a-e1bb5bcd3008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:15.563825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc1d0d-8e5d-4b63-a47a-e1bb5bcd3008 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.564142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc1d0d-8e5d-4b63-a47a-e1bb5bcd3008 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.564457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc1d0d-8e5d-4b63-a47a-e1bb5bcd3008 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.565195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc1d0d-8e5d-4b63-a47a-e1bb5bcd3008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:15.566800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc1d0d-8e5d-4b63-a47a-e1bb5bcd3008 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:15.577456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1114/2233] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:15.581444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc1d0d-8e5d-4b63-a47a-e1bb5bcd3008 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:15.591410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc1d0d-8e5d-4b63-a47a-e1bb5bcd3008 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:15.596284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6645423-42d0-44ed-8f75-4d7c22423a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:15.597197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6645423-42d0-44ed-8f75-4d7c22423a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.597480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6645423-42d0-44ed-8f75-4d7c22423a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.597755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6645423-42d0-44ed-8f75-4d7c22423a58 admin admin] PATH_INFO: `/v3/projects/3508396f80944396bfac681968f3e7bb/users/26ad624371f74f95aa5a1fa15e597c84/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.616874 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6645423-42d0-44ed-8f75-4d7c22423a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3508396f80944396bfac681968f3e7bb, user_id=26ad624371f74f95aa5a1fa15e597c84, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:15.619636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6645423-42d0-44ed-8f75-4d7c22423a58 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:15.709988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0136b408e343d198950c3792e3f019'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:15.710749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0136b408e343d198950c3792e3f019'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:15.711516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0136b408e343d198950c3792e3f019'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:15.713610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1115/2234] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:15 2021] PUT /identity/v3/projects/3508396f80944396bfac681968f3e7bb/users/26ad624371f74f95aa5a1fa15e597c84/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:15.717675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6645423-42d0-44ed-8f75-4d7c22423a58 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:15.722012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a6645423-42d0-44ed-8f75-4d7c22423a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:15.732392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0136b408e343d198950c3792e3f019'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:15.787732 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6645423-42d0-44ed-8f75-4d7c22423a58 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:15.793401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0136b408e343d198950c3792e3f019'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:15.797193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a06c4a-327c-42ef-a833-9201be30723b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:15.797978 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06c4a-327c-42ef-a833-9201be30723b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.798334 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06c4a-327c-42ef-a833-9201be30723b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.798672 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06c4a-327c-42ef-a833-9201be30723b admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.799487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a06c4a-327c-42ef-a833-9201be30723b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:15.801234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a06c4a-327c-42ef-a833-9201be30723b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:15.808496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1120/2235] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:15 2021] DELETE /identity/v3/users/ff0136b408e343d198950c3792e3f019 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:15.814317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1116/2236] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:15.818449 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:15.889493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1292-6ae5-4dcd-90f6-da269f78dc33 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:15.894640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253f593-fe05-4c3a-9a81-5c47efff5a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:15.895547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253f593-fe05-4c3a-9a81-5c47efff5a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.895829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253f593-fe05-4c3a-9a81-5c47efff5a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.896263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253f593-fe05-4c3a-9a81-5c47efff5a72 admin admin] PATH_INFO: `/v3/projects/3508396f80944396bfac681968f3e7bb/users/26ad624371f74f95aa5a1fa15e597c84/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.898521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253f593-fe05-4c3a-9a81-5c47efff5a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3508396f80944396bfac681968f3e7bb, user_id=26ad624371f74f95aa5a1fa15e597c84, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:15.902675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253f593-fe05-4c3a-9a81-5c47efff5a72 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:15.913842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1121/2237] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:15 2021] PUT /identity/v3/projects/3508396f80944396bfac681968f3e7bb/users/26ad624371f74f95aa5a1fa15e597c84/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:15.925823 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6712b3-54cc-4ce0-bb84-6f36c42e1c9c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.926110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6712b3-54cc-4ce0-bb84-6f36c42e1c9c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.926410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6712b3-54cc-4ce0-bb84-6f36c42e1c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.956762 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-dc6712b3-54cc-4ce0-bb84-6f36c42e1c9c None None] MFA Rules not processed for user `26ad624371f74f95aa5a1fa15e597c84`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:15.958006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-dc6712b3-54cc-4ce0-bb84-6f36c42e1c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:16.043684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1117/2238] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:15 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:16.054050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253f593-fe05-4c3a-9a81-5c47efff5a72 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:16.055725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a253f593-fe05-4c3a-9a81-5c47efff5a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:16.119968 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253f593-fe05-4c3a-9a81-5c47efff5a72 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:16.124712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1afc0e-8af7-480d-8829-6d56f6eb5359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:16.125370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1afc0e-8af7-480d-8829-6d56f6eb5359 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:16.125652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1afc0e-8af7-480d-8829-6d56f6eb5359 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:16.125952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1afc0e-8af7-480d-8829-6d56f6eb5359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.137329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1afc0e-8af7-480d-8829-6d56f6eb5359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:16.138800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1afc0e-8af7-480d-8829-6d56f6eb5359 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:16.148828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1122/2239] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:16 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:16.280473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6712b3-54cc-4ce0-bb84-6f36c42e1c9c None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:16.281953 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-dc6712b3-54cc-4ce0-bb84-6f36c42e1c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:16.349168 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6712b3-54cc-4ce0-bb84-6f36c42e1c9c None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:16.353931 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:16.355305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:16.355588 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:16.355862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] PATH_INFO: `/v3/projects/c83d526bede447cab37ce8892989ce74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.358240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c83d526bede447cab37ce8892989ce74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:16.360155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:16.363578 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1afc0e-8af7-480d-8829-6d56f6eb5359 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:16.373064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1afc0e-8af7-480d-8829-6d56f6eb5359 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:16.376630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce88fde-971e-4bec-aa3d-2e348a778353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:16.377263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce88fde-971e-4bec-aa3d-2e348a778353 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:16.377570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce88fde-971e-4bec-aa3d-2e348a778353 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:16.377843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce88fde-971e-4bec-aa3d-2e348a778353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.379589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7ce88fde-971e-4bec-aa3d-2e348a778353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:16.440446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce88fde-971e-4bec-aa3d-2e348a778353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:16.441979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce88fde-971e-4bec-aa3d-2e348a778353 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:16.450892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1123/2240] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:16 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:46:16.497359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c83d526bede447cab37ce8892989ce74', 'request_id': 'req-5669c420-7631-4987-a8b6-bc20ffb4d869'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:16.503785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c83d526bede447cab37ce8892989ce74', 'request_id': 'req-5669c420-7631-4987-a8b6-bc20ffb4d869'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:16.509322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c83d526bede447cab37ce8892989ce74', 'request_id': 'req-5669c420-7631-4987-a8b6-bc20ffb4d869'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:16.592452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] The token cache is being invalidate because project c83d526bede447cab37ce8892989ce74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:16.592791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:16.593376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5669c420-7631-4987-a8b6-bc20ffb4d869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:16.594955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1118/2241] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:16 2021] DELETE /identity/v3/projects/c83d526bede447cab37ce8892989ce74 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:16.600739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8295a-ca3f-4ef6-936f-fe2d10f68c41 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:16.601091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8295a-ca3f-4ef6-936f-fe2d10f68c41 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:16.601382 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8295a-ca3f-4ef6-936f-fe2d10f68c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.619825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7eb8295a-ca3f-4ef6-936f-fe2d10f68c41 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:16.621174 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7eb8295a-ca3f-4ef6-936f-fe2d10f68c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:16.697529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1124/2242] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:16.699708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba719af-4ef2-4bfb-98f4-d3a3f1fc1a14 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:16.700095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba719af-4ef2-4bfb-98f4-d3a3f1fc1a14 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:16.700479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba719af-4ef2-4bfb-98f4-d3a3f1fc1a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.721228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4ba719af-4ef2-4bfb-98f4-d3a3f1fc1a14 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:16.722488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4ba719af-4ef2-4bfb-98f4-d3a3f1fc1a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:16.731142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1119/2243] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:16.735569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8295a-ca3f-4ef6-936f-fe2d10f68c41 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:16.745451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8295a-ca3f-4ef6-936f-fe2d10f68c41 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:16.750059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04120c-e598-4c86-bc4a-91cbf020cc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:16.750707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04120c-e598-4c86-bc4a-91cbf020cc20 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:16.750990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04120c-e598-4c86-bc4a-91cbf020cc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:16.751266 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04120c-e598-4c86-bc4a-91cbf020cc20 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.752005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04120c-e598-4c86-bc4a-91cbf020cc20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:16.752299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04120c-e598-4c86-bc4a-91cbf020cc20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:16.754038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04120c-e598-4c86-bc4a-91cbf020cc20 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:16.766588 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1125/2244] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:46:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:16.770985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba719af-4ef2-4bfb-98f4-d3a3f1fc1a14 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:16.781509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba719af-4ef2-4bfb-98f4-d3a3f1fc1a14 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:16.791216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1282-73c8-45ee-8d9e-ca1f848fbfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:16.791216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1282-73c8-45ee-8d9e-ca1f848fbfad admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:16.791216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1282-73c8-45ee-8d9e-ca1f848fbfad admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:16.791216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1282-73c8-45ee-8d9e-ca1f848fbfad admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.791846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1282-73c8-45ee-8d9e-ca1f848fbfad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:16.791846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1282-73c8-45ee-8d9e-ca1f848fbfad admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:16.917510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1120/2245] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:46:16 2021] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:16.919029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04120c-e598-4c86-bc4a-91cbf020cc20 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:16.931098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04120c-e598-4c86-bc4a-91cbf020cc20 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:16.990988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabaa5f-6f4e-49a5-a28e-72e05b02ba16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:16.991656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabaa5f-6f4e-49a5-a28e-72e05b02ba16 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:16.992048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabaa5f-6f4e-49a5-a28e-72e05b02ba16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:16.992329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabaa5f-6f4e-49a5-a28e-72e05b02ba16 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.993072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabaa5f-6f4e-49a5-a28e-72e05b02ba16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:16.995065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabaa5f-6f4e-49a5-a28e-72e05b02ba16 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:17.196693 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1126/2246] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:46:16 2021] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:17.197924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1282-73c8-45ee-8d9e-ca1f848fbfad admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:17.208936 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1282-73c8-45ee-8d9e-ca1f848fbfad admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:17.213700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dee652-fce5-4fdf-bbc2-8c14b950ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:17.214949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dee652-fce5-4fdf-bbc2-8c14b950ac87 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.215235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dee652-fce5-4fdf-bbc2-8c14b950ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.217795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dee652-fce5-4fdf-bbc2-8c14b950ac87 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.217795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dee652-fce5-4fdf-bbc2-8c14b950ac87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:17.218055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dee652-fce5-4fdf-bbc2-8c14b950ac87 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:17.230289 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1121/2247] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:17.232763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabaa5f-6f4e-49a5-a28e-72e05b02ba16 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:17.242926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabaa5f-6f4e-49a5-a28e-72e05b02ba16 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:17.247637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbaea9-a3f6-4eba-87fd-f244bf7221e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:17.248340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbaea9-a3f6-4eba-87fd-f244bf7221e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.248650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbaea9-a3f6-4eba-87fd-f244bf7221e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.248928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbaea9-a3f6-4eba-87fd-f244bf7221e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.249659 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbaea9-a3f6-4eba-87fd-f244bf7221e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:17.251258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbaea9-a3f6-4eba-87fd-f244bf7221e5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:17.261741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1127/2248] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:17.270182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dee652-fce5-4fdf-bbc2-8c14b950ac87 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:17.281279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dee652-fce5-4fdf-bbc2-8c14b950ac87 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:17.289550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9bb64-81d2-484e-b5aa-25898afcd2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:17.291299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9bb64-81d2-484e-b5aa-25898afcd2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.291581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9bb64-81d2-484e-b5aa-25898afcd2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.291860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9bb64-81d2-484e-b5aa-25898afcd2ef admin admin] PATH_INFO: `/v3/projects/a78e9c31904b4368a17c4641de27a1dc/users/57108f1dea6d4b06bf4dd967e6a993a7/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.308539 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9bb64-81d2-484e-b5aa-25898afcd2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78e9c31904b4368a17c4641de27a1dc, user_id=57108f1dea6d4b06bf4dd967e6a993a7, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:17.315251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9bb64-81d2-484e-b5aa-25898afcd2ef admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:17.401226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1122/2249] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:17 2021] PUT /identity/v3/projects/a78e9c31904b4368a17c4641de27a1dc/users/57108f1dea6d4b06bf4dd967e6a993a7/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:17.410198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03842cc4-b133-4290-ab1e-1936074a2edb None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.410606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03842cc4-b133-4290-ab1e-1936074a2edb None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.410867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03842cc4-b133-4290-ab1e-1936074a2edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.440970 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-03842cc4-b133-4290-ab1e-1936074a2edb None None] MFA Rules not processed for user `57108f1dea6d4b06bf4dd967e6a993a7`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:17.442242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-03842cc4-b133-4290-ab1e-1936074a2edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:17.516282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1128/2250] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:17 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:17.520833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9bb64-81d2-484e-b5aa-25898afcd2ef admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:17.588558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9bb64-81d2-484e-b5aa-25898afcd2ef admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:17.594398 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57297a56-bdeb-4778-9c6e-4c20bed26dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:17.594909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57297a56-bdeb-4778-9c6e-4c20bed26dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.595196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57297a56-bdeb-4778-9c6e-4c20bed26dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.595468 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57297a56-bdeb-4778-9c6e-4c20bed26dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.596178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57297a56-bdeb-4778-9c6e-4c20bed26dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:17.598238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57297a56-bdeb-4778-9c6e-4c20bed26dc7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:17.721824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1123/2251] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:46:17 2021] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:17.723429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03842cc4-b133-4290-ab1e-1936074a2edb None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:17.735654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03842cc4-b133-4290-ab1e-1936074a2edb None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:17.794825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3326d71-520c-4c0d-a53d-a3de5de0989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:17.795500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326d71-520c-4c0d-a53d-a3de5de0989f admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.795784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326d71-520c-4c0d-a53d-a3de5de0989f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.796065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326d71-520c-4c0d-a53d-a3de5de0989f admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.796817 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3326d71-520c-4c0d-a53d-a3de5de0989f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:17.798888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3326d71-520c-4c0d-a53d-a3de5de0989f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:17.952678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1129/2252] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:46:17 2021] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:17.956329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57297a56-bdeb-4778-9c6e-4c20bed26dc7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:17.966585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57297a56-bdeb-4778-9c6e-4c20bed26dc7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:17.971238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d596d-3a16-4aa0-b28d-d8408462da62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:17.971914 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d596d-3a16-4aa0-b28d-d8408462da62 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.972196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d596d-3a16-4aa0-b28d-d8408462da62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.972507 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d596d-3a16-4aa0-b28d-d8408462da62 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.973246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d596d-3a16-4aa0-b28d-d8408462da62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:17.974859 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d596d-3a16-4aa0-b28d-d8408462da62 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:17.986550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1124/2253] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:17.990859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3326d71-520c-4c0d-a53d-a3de5de0989f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:18.001986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3326d71-520c-4c0d-a53d-a3de5de0989f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:18.006668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f6b6a-27c9-4cd1-8b90-c723cf328be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:18.007691 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f6b6a-27c9-4cd1-8b90-c723cf328be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:18.007977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f6b6a-27c9-4cd1-8b90-c723cf328be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:18.008251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f6b6a-27c9-4cd1-8b90-c723cf328be3 admin admin] PATH_INFO: `/v3/projects/46fe66da4e3d4580838fd19a861d2c56/users/15c9b4f969e743218dcfa1bccb2c8802/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:18.023028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f6b6a-27c9-4cd1-8b90-c723cf328be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe66da4e3d4580838fd19a861d2c56, user_id=15c9b4f969e743218dcfa1bccb2c8802, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:18.025737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f6b6a-27c9-4cd1-8b90-c723cf328be3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:18.083619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1130/2254] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:17 2021] PUT /identity/v3/projects/46fe66da4e3d4580838fd19a861d2c56/users/15c9b4f969e743218dcfa1bccb2c8802/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:18.087546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d596d-3a16-4aa0-b28d-d8408462da62 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:18.098354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d596d-3a16-4aa0-b28d-d8408462da62 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:18.158293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ca659-d022-4323-87d2-fb47c38983fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:18.158958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ca659-d022-4323-87d2-fb47c38983fe admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:18.159239 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ca659-d022-4323-87d2-fb47c38983fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:18.159535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ca659-d022-4323-87d2-fb47c38983fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:18.160256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ca659-d022-4323-87d2-fb47c38983fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:18.161874 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ca659-d022-4323-87d2-fb47c38983fe admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:18.173151 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1125/2255] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:18 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:18.177470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f6b6a-27c9-4cd1-8b90-c723cf328be3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:18.190750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f6b6a-27c9-4cd1-8b90-c723cf328be3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:18.193073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05a901-6014-4aa8-8b47-3ae40b4d693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:18.194119 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a901-6014-4aa8-8b47-3ae40b4d693a admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:18.194476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a901-6014-4aa8-8b47-3ae40b4d693a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:18.194763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a901-6014-4aa8-8b47-3ae40b4d693a admin admin] PATH_INFO: `/v3/projects/46fe66da4e3d4580838fd19a861d2c56/users/15c9b4f969e743218dcfa1bccb2c8802/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:18.197626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05a901-6014-4aa8-8b47-3ae40b4d693a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe66da4e3d4580838fd19a861d2c56, user_id=15c9b4f969e743218dcfa1bccb2c8802, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:18.200337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05a901-6014-4aa8-8b47-3ae40b4d693a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:18.216546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1131/2256] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:18 2021] PUT /identity/v3/projects/46fe66da4e3d4580838fd19a861d2c56/users/15c9b4f969e743218dcfa1bccb2c8802/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:18.222264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f801-e9e4-43af-a820-3bab0c694d65 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:18.222790 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f801-e9e4-43af-a820-3bab0c694d65 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:18.222901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f801-e9e4-43af-a820-3bab0c694d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:18.250041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-1306f801-e9e4-43af-a820-3bab0c694d65 None None] MFA Rules not processed for user `15c9b4f969e743218dcfa1bccb2c8802`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:18.251267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1306f801-e9e4-43af-a820-3bab0c694d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:18.319820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1126/2257] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:18 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:18.330215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05a901-6014-4aa8-8b47-3ae40b4d693a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:18.331898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ec05a901-6014-4aa8-8b47-3ae40b4d693a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:18.387846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05a901-6014-4aa8-8b47-3ae40b4d693a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:18.392161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acdfaa-e621-4693-82b8-5da9c3af65bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:18.392848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acdfaa-e621-4693-82b8-5da9c3af65bd service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:18.393153 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acdfaa-e621-4693-82b8-5da9c3af65bd service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:18.393440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acdfaa-e621-4693-82b8-5da9c3af65bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:18.403361 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acdfaa-e621-4693-82b8-5da9c3af65bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:18.404883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acdfaa-e621-4693-82b8-5da9c3af65bd service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:18.414641 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1132/2258] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:18 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:19.011545 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f801-e9e4-43af-a820-3bab0c694d65 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:19.078765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f801-e9e4-43af-a820-3bab0c694d65 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:19.083612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:19.084514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:19.084801 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:19.085074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] PATH_INFO: `/v3/users/57108f1dea6d4b06bf4dd967e6a993a7` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:19.086389 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57108f1dea6d4b06bf4dd967e6a993a7)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:19.088614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:19.323144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57108f1dea6d4b06bf4dd967e6a993a7'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:19.350168 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57108f1dea6d4b06bf4dd967e6a993a7'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:19.351288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57108f1dea6d4b06bf4dd967e6a993a7'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:19.360269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57108f1dea6d4b06bf4dd967e6a993a7'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:19.476909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57108f1dea6d4b06bf4dd967e6a993a7'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:19.483900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1127/2259] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:19 2021] DELETE /identity/v3/users/57108f1dea6d4b06bf4dd967e6a993a7 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:19.488522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dca4c-160e-4aad-915d-79a6023a678f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:19.489050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dca4c-160e-4aad-915d-79a6023a678f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:19.489483 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dca4c-160e-4aad-915d-79a6023a678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:19.509812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b85dca4c-160e-4aad-915d-79a6023a678f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:19.510204 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b85dca4c-160e-4aad-915d-79a6023a678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:19.592390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1133/2260] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:19.606989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:19.607370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:19.681541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7948-9461-4dd8-b800-18f719a15492 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:19.685875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be94af-4883-4254-a653-5eda77a25913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:19.686726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be94af-4883-4254-a653-5eda77a25913 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:19.687296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be94af-4883-4254-a653-5eda77a25913 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:19.687807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be94af-4883-4254-a653-5eda77a25913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:19.709467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be94af-4883-4254-a653-5eda77a25913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:19.711172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be94af-4883-4254-a653-5eda77a25913 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:19.723189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1128/2261] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:20.008482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798ccc-0f4c-46cf-b331-410652e1a33b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:20.010460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798ccc-0f4c-46cf-b331-410652e1a33b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:20.010460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798ccc-0f4c-46cf-b331-410652e1a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:20.028771 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-db798ccc-0f4c-46cf-b331-410652e1a33b None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:20.030040 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-db798ccc-0f4c-46cf-b331-410652e1a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:20.106413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1134/2262] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:46:20 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:20.123116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be94af-4883-4254-a653-5eda77a25913 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:20.124786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-81be94af-4883-4254-a653-5eda77a25913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:20.260570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be94af-4883-4254-a653-5eda77a25913 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:20.268886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa5e29-0d47-4c15-b927-063262c0974d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:20.273349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa5e29-0d47-4c15-b927-063262c0974d service swift] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:20.273349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa5e29-0d47-4c15-b927-063262c0974d service swift] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:20.273349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa5e29-0d47-4c15-b927-063262c0974d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:20.281597 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa5e29-0d47-4c15-b927-063262c0974d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:20.284021 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa5e29-0d47-4c15-b927-063262c0974d service swift] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:20.326340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1129/2263] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:46:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:21.015459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db798ccc-0f4c-46cf-b331-410652e1a33b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:21.020603 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-db798ccc-0f4c-46cf-b331-410652e1a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:21.061677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db798ccc-0f4c-46cf-b331-410652e1a33b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:21.097267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:21.097267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:21.097267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:21.097267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] PATH_INFO: `/v3/projects/a78e9c31904b4368a17c4641de27a1dc` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:21.097849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78e9c31904b4368a17c4641de27a1dc)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:21.097849 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:21.274183 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78e9c31904b4368a17c4641de27a1dc', 'request_id': 'req-21f8c948-5bf3-47da-88ae-b963bc9981b8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:21.343898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78e9c31904b4368a17c4641de27a1dc', 'request_id': 'req-21f8c948-5bf3-47da-88ae-b963bc9981b8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:21.350708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78e9c31904b4368a17c4641de27a1dc', 'request_id': 'req-21f8c948-5bf3-47da-88ae-b963bc9981b8'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:21.393392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] The token cache is being invalidate because project a78e9c31904b4368a17c4641de27a1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:21.393392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:21.393392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:21.393392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1135/2264] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:21 2021] DELETE /identity/v3/projects/a78e9c31904b4368a17c4641de27a1dc => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:21.424099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa5e29-0d47-4c15-b927-063262c0974d service swift] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:21.460453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa5e29-0d47-4c15-b927-063262c0974d service swift] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:21.597891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:21.598768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:21.604864 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:21.605487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] PATH_INFO: `/v3/users/15c9b4f969e743218dcfa1bccb2c8802` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:21.606995 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c9b4f969e743218dcfa1bccb2c8802)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:21.609234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:21.881448 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c9b4f969e743218dcfa1bccb2c8802'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:21.897101 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c9b4f969e743218dcfa1bccb2c8802'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:21.897920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c9b4f969e743218dcfa1bccb2c8802'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:21.905246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c9b4f969e743218dcfa1bccb2c8802'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:21.975315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c9b4f969e743218dcfa1bccb2c8802'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:21.982110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1130/2265] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:21 2021] DELETE /identity/v3/users/15c9b4f969e743218dcfa1bccb2c8802 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:22.490601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:22.493716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:22.508431 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8c948-5bf3-47da-88ae-b963bc9981b8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:22.568468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:22.569338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:22.569653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:22.569982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] PATH_INFO: `/v3/projects/46fe66da4e3d4580838fd19a861d2c56` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:22.571168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] RBAC: Authorizing `identity:delete_project(project_id=46fe66da4e3d4580838fd19a861d2c56)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:22.573253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:22.724418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46fe66da4e3d4580838fd19a861d2c56', 'request_id': 'req-85304046-03b3-4fc1-a252-02c71ec1967e'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:22.780858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46fe66da4e3d4580838fd19a861d2c56', 'request_id': 'req-85304046-03b3-4fc1-a252-02c71ec1967e'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:22.786930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46fe66da4e3d4580838fd19a861d2c56', 'request_id': 'req-85304046-03b3-4fc1-a252-02c71ec1967e'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:22.798384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] The token cache is being invalidate because project 46fe66da4e3d4580838fd19a861d2c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:22.798683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:22.799311 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-85304046-03b3-4fc1-a252-02c71ec1967e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:22.800886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1136/2266] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:22 2021] DELETE /identity/v3/projects/46fe66da4e3d4580838fd19a861d2c56 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:26.612467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:26.614016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:26.627740 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156fc5c-35bc-482b-a5ea-4e4cafb78d0e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:26.711321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:26.712516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:26.713007 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:26.713518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] PATH_INFO: `/v3/users/87cecd0b15c6496fbeeaaed4749d59a3` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:26.716290 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cecd0b15c6496fbeeaaed4749d59a3)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:26.720330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:26.962924 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cecd0b15c6496fbeeaaed4749d59a3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:26.992687 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cecd0b15c6496fbeeaaed4749d59a3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:26.993519 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cecd0b15c6496fbeeaaed4749d59a3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:27.002719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cecd0b15c6496fbeeaaed4749d59a3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:27.113628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cecd0b15c6496fbeeaaed4749d59a3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:27.127374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1131/2267] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:26 2021] DELETE /identity/v3/users/87cecd0b15c6496fbeeaaed4749d59a3 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:27.130770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7c96-9ed8-48bb-a2d8-f6045acda691 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:27.138124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7c96-9ed8-48bb-a2d8-f6045acda691 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:27.138124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7c96-9ed8-48bb-a2d8-f6045acda691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:27.170137 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-190d7c96-9ed8-48bb-a2d8-f6045acda691 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:27.171628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-190d7c96-9ed8-48bb-a2d8-f6045acda691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:27.296574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1137/2268] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:27.303598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:27.305154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:27.372089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf55ca-6461-418a-acdf-7869e3358167 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:27.376510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0ec53-ddaa-48c5-975a-380eebec4167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:27.377263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0ec53-ddaa-48c5-975a-380eebec4167 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:27.377550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0ec53-ddaa-48c5-975a-380eebec4167 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:27.378129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0ec53-ddaa-48c5-975a-380eebec4167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:27.391024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0ec53-ddaa-48c5-975a-380eebec4167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:27.392792 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0ec53-ddaa-48c5-975a-380eebec4167 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:27.405689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1132/2269] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:27.880272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d7c96-9ed8-48bb-a2d8-f6045acda691 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:27.881773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-190d7c96-9ed8-48bb-a2d8-f6045acda691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:27.901743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d7c96-9ed8-48bb-a2d8-f6045acda691 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:27.930790 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:27.931696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:27.931987 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:27.932254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] PATH_INFO: `/v3/projects/76ea3aae3c3c48309d8b899e6f37f055` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:27.934019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ea3aae3c3c48309d8b899e6f37f055)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:27.936011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:28.063625 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ea3aae3c3c48309d8b899e6f37f055', 'request_id': 'req-978c8545-66ed-439f-b911-5a135d386c40'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.134079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ea3aae3c3c48309d8b899e6f37f055', 'request_id': 'req-978c8545-66ed-439f-b911-5a135d386c40'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.141494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ea3aae3c3c48309d8b899e6f37f055', 'request_id': 'req-978c8545-66ed-439f-b911-5a135d386c40'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.155393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] The token cache is being invalidate because project 76ea3aae3c3c48309d8b899e6f37f055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:28.155729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.156343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.158300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1138/2270] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:27 2021] DELETE /identity/v3/projects/76ea3aae3c3c48309d8b899e6f37f055 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:28.161965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0ec53-ddaa-48c5-975a-380eebec4167 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:28.173868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0ec53-ddaa-48c5-975a-380eebec4167 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:28.270302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:28.272107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:28.272827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:28.273398 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] PATH_INFO: `/v3/users/26ad624371f74f95aa5a1fa15e597c84` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:28.277756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ad624371f74f95aa5a1fa15e597c84)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:28.281111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:28.524684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ad624371f74f95aa5a1fa15e597c84'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.543877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ad624371f74f95aa5a1fa15e597c84'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.544936 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ad624371f74f95aa5a1fa15e597c84'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.552688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ad624371f74f95aa5a1fa15e597c84'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.648571 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-aecc16df-e714-4cb1-a7ad-a6be2276237b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ad624371f74f95aa5a1fa15e597c84'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.656116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1133/2271] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:28 2021] DELETE /identity/v3/users/26ad624371f74f95aa5a1fa15e597c84 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:29.151125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:29.156198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:29.212166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c8545-66ed-439f-b911-5a135d386c40 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:29.348251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:29.352091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:29.352091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:29.352091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] PATH_INFO: `/v3/projects/3508396f80944396bfac681968f3e7bb` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:29.352405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3508396f80944396bfac681968f3e7bb)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:29.354724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:29.454554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3508396f80944396bfac681968f3e7bb', 'request_id': 'req-45aec7a9-3265-488a-a54b-92c5816f3438'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:29.536829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3508396f80944396bfac681968f3e7bb', 'request_id': 'req-45aec7a9-3265-488a-a54b-92c5816f3438'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:29.544241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3508396f80944396bfac681968f3e7bb', 'request_id': 'req-45aec7a9-3265-488a-a54b-92c5816f3438'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:29.578957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] The token cache is being invalidate because project 3508396f80944396bfac681968f3e7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:29.579377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:29.580013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-45aec7a9-3265-488a-a54b-92c5816f3438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:29.586339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1139/2272] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:29 2021] DELETE /identity/v3/projects/3508396f80944396bfac681968f3e7bb => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:29.587991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e597dd-e695-46f7-a987-1c080e1236d1 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:29.588493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e597dd-e695-46f7-a987-1c080e1236d1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:29.588615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e597dd-e695-46f7-a987-1c080e1236d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:29.669484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-61e597dd-e695-46f7-a987-1c080e1236d1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:29.670920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-61e597dd-e695-46f7-a987-1c080e1236d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:29.819455 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1134/2273] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:29.820999 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10ffb2-38bf-4233-8ffe-8d38e475ac5e None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:29.821390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10ffb2-38bf-4233-8ffe-8d38e475ac5e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:29.822009 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10ffb2-38bf-4233-8ffe-8d38e475ac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:29.842293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-fd10ffb2-38bf-4233-8ffe-8d38e475ac5e None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:29.843529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-fd10ffb2-38bf-4233-8ffe-8d38e475ac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:29.853387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1140/2274] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:29.858147 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e597dd-e695-46f7-a987-1c080e1236d1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:29.869318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e597dd-e695-46f7-a987-1c080e1236d1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:29.875373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e6318-2ef2-4021-aa63-9ad7a50dff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:29.876466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e6318-2ef2-4021-aa63-9ad7a50dff70 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:29.876466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e6318-2ef2-4021-aa63-9ad7a50dff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:29.876760 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e6318-2ef2-4021-aa63-9ad7a50dff70 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:29.877514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e6318-2ef2-4021-aa63-9ad7a50dff70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:29.877797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e6318-2ef2-4021-aa63-9ad7a50dff70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:29.879402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e6318-2ef2-4021-aa63-9ad7a50dff70 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:29.899316 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1135/2275] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:46:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:29.900956 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10ffb2-38bf-4233-8ffe-8d38e475ac5e None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:29.916746 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10ffb2-38bf-4233-8ffe-8d38e475ac5e None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:29.922803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198032a-b04d-4ae4-abb6-5c78ccc49743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:29.923477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198032a-b04d-4ae4-abb6-5c78ccc49743 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:29.923763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198032a-b04d-4ae4-abb6-5c78ccc49743 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:29.924043 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198032a-b04d-4ae4-abb6-5c78ccc49743 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:29.924789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198032a-b04d-4ae4-abb6-5c78ccc49743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:29.926700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198032a-b04d-4ae4-abb6-5c78ccc49743 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:30.061370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1141/2276] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:46:29 2021] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:30.064786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e6318-2ef2-4021-aa63-9ad7a50dff70 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:30.078026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e6318-2ef2-4021-aa63-9ad7a50dff70 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:30.166454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442719d-0634-4f49-9b61-a06fb02b43fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:30.167171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442719d-0634-4f49-9b61-a06fb02b43fe admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.167464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442719d-0634-4f49-9b61-a06fb02b43fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.167803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442719d-0634-4f49-9b61-a06fb02b43fe admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.169299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442719d-0634-4f49-9b61-a06fb02b43fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:30.171464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442719d-0634-4f49-9b61-a06fb02b43fe admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:30.314493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1136/2277] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:46:30 2021] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:30.315702 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198032a-b04d-4ae4-abb6-5c78ccc49743 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:30.326386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198032a-b04d-4ae4-abb6-5c78ccc49743 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:30.331435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e429-598e-4542-9e4a-aa6a77476e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:30.332114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e429-598e-4542-9e4a-aa6a77476e4e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.332444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e429-598e-4542-9e4a-aa6a77476e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.332728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e429-598e-4542-9e4a-aa6a77476e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.333507 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425e429-598e-4542-9e4a-aa6a77476e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:30.335128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425e429-598e-4542-9e4a-aa6a77476e4e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:30.352173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1142/2278] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:30 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:30.353003 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442719d-0634-4f49-9b61-a06fb02b43fe admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:30.365588 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442719d-0634-4f49-9b61-a06fb02b43fe admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:30.371077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56df22-9d1a-4a5e-8d1d-92b2a5097b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:30.371914 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56df22-9d1a-4a5e-8d1d-92b2a5097b95 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.372330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56df22-9d1a-4a5e-8d1d-92b2a5097b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.372748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56df22-9d1a-4a5e-8d1d-92b2a5097b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.373752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56df22-9d1a-4a5e-8d1d-92b2a5097b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:30.375858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56df22-9d1a-4a5e-8d1d-92b2a5097b95 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:30.394524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1137/2279] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:30 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:30.401796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e429-598e-4542-9e4a-aa6a77476e4e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:30.411858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e429-598e-4542-9e4a-aa6a77476e4e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:30.425480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77b46-55db-43e5-bdea-bc4a00619406 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.426453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77b46-55db-43e5-bdea-bc4a00619406 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.426749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77b46-55db-43e5-bdea-bc4a00619406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.432203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d446dea-a513-4805-8163-cb4d24a9566b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:30.441848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d446dea-a513-4805-8163-cb4d24a9566b admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.441848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d446dea-a513-4805-8163-cb4d24a9566b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.441848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d446dea-a513-4805-8163-cb4d24a9566b admin admin] PATH_INFO: `/v3/projects/617153db413a41c4b476f446794cb806/users/27a3d5fb401f47d28ba6af0da24cc128/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.458173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-8df77b46-55db-43e5-bdea-bc4a00619406 None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:30.460027 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8df77b46-55db-43e5-bdea-bc4a00619406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:30.478292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d446dea-a513-4805-8163-cb4d24a9566b admin admin] RBAC: Authorizing `identity:create_grant(project_id=617153db413a41c4b476f446794cb806, user_id=27a3d5fb401f47d28ba6af0da24cc128, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:30.485044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d446dea-a513-4805-8163-cb4d24a9566b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:30.588803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1138/2280] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:46:30 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:30.591692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1143/2281] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:30 2021] PUT /identity/v3/projects/617153db413a41c4b476f446794cb806/users/27a3d5fb401f47d28ba6af0da24cc128/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:30.602535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccc17e-52d8-4453-9bab-8cb30e0c1b26 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.602865 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccc17e-52d8-4453-9bab-8cb30e0c1b26 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.604955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccc17e-52d8-4453-9bab-8cb30e0c1b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.660668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d446dea-a513-4805-8163-cb4d24a9566b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:30.665255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9d446dea-a513-4805-8163-cb4d24a9566b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:30.668503 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ffccc17e-52d8-4453-9bab-8cb30e0c1b26 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:30.669770 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ffccc17e-52d8-4453-9bab-8cb30e0c1b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:30.788042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d446dea-a513-4805-8163-cb4d24a9566b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:30.815897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdddc9d-719b-4c15-a466-5610d7015648 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:30.816589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdddc9d-719b-4c15-a466-5610d7015648 service swift] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.817017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdddc9d-719b-4c15-a466-5610d7015648 service swift] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.817312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdddc9d-719b-4c15-a466-5610d7015648 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.830527 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1139/2282] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:30.845054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccc17e-52d8-4453-9bab-8cb30e0c1b26 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:30.846998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ffccc17e-52d8-4453-9bab-8cb30e0c1b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:30.978932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdddc9d-719b-4c15-a466-5610d7015648 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:30.980730 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdddc9d-719b-4c15-a466-5610d7015648 service swift] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:31.004768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1144/2283] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:46:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:31.076697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccc17e-52d8-4453-9bab-8cb30e0c1b26 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:31.093060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1fa56-b05e-40b9-bb4f-5fcd10d049e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:31.093734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1fa56-b05e-40b9-bb4f-5fcd10d049e1 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:31.094019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1fa56-b05e-40b9-bb4f-5fcd10d049e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:31.094293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1fa56-b05e-40b9-bb4f-5fcd10d049e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:31.121819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1fa56-b05e-40b9-bb4f-5fcd10d049e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:31.128478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1fa56-b05e-40b9-bb4f-5fcd10d049e1 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:31.151517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1140/2284] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:33.608670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ced766-ede6-40ee-a96b-355f62efbff5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:33.609982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ced766-ede6-40ee-a96b-355f62efbff5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:33.610768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ced766-ede6-40ee-a96b-355f62efbff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:33.750306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c4ced766-ede6-40ee-a96b-355f62efbff5 None None] MFA Rules not processed for user `27a3d5fb401f47d28ba6af0da24cc128`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:33.754412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c4ced766-ede6-40ee-a96b-355f62efbff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:34.006666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1145/2285] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:33 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:34.014896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1fa56-b05e-40b9-bb4f-5fcd10d049e1 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:34.033533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1fa56-b05e-40b9-bb4f-5fcd10d049e1 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:34.041665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079b5ce-5bb9-410b-8e7c-995a6fe9b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:34.042855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079b5ce-5bb9-410b-8e7c-995a6fe9b884 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.043480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079b5ce-5bb9-410b-8e7c-995a6fe9b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.044022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079b5ce-5bb9-410b-8e7c-995a6fe9b884 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.045673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079b5ce-5bb9-410b-8e7c-995a6fe9b884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:34.049109 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079b5ce-5bb9-410b-8e7c-995a6fe9b884 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:34.154393 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1141/2286] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:46:34 2021] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:34.159799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ced766-ede6-40ee-a96b-355f62efbff5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:34.180258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ced766-ede6-40ee-a96b-355f62efbff5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:34.287656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bd1db-8ef0-4f26-ba7a-ee8f380c61e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:34.289292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd1db-8ef0-4f26-ba7a-ee8f380c61e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.291112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd1db-8ef0-4f26-ba7a-ee8f380c61e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.293399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd1db-8ef0-4f26-ba7a-ee8f380c61e7 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.302186 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bd1db-8ef0-4f26-ba7a-ee8f380c61e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:34.304002 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bd1db-8ef0-4f26-ba7a-ee8f380c61e7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:34.406027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1146/2287] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:46:34 2021] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:34.410114 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079b5ce-5bb9-410b-8e7c-995a6fe9b884 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:34.430288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079b5ce-5bb9-410b-8e7c-995a6fe9b884 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:34.449215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b61a36-04ca-4cdc-ab54-0c9109277c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:34.449934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b61a36-04ca-4cdc-ab54-0c9109277c5a admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.450244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b61a36-04ca-4cdc-ab54-0c9109277c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.450508 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b61a36-04ca-4cdc-ab54-0c9109277c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.451254 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b61a36-04ca-4cdc-ab54-0c9109277c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:34.452943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b61a36-04ca-4cdc-ab54-0c9109277c5a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:34.499305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1142/2288] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:34 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:34.506172 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bd1db-8ef0-4f26-ba7a-ee8f380c61e7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:34.605882 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bd1db-8ef0-4f26-ba7a-ee8f380c61e7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:34.635800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5e359-0b8b-4591-99bd-bfb3b8619c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:34.635800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5e359-0b8b-4591-99bd-bfb3b8619c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.635800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5e359-0b8b-4591-99bd-bfb3b8619c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.635800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5e359-0b8b-4591-99bd-bfb3b8619c38 admin admin] PATH_INFO: `/v3/projects/79d2e5cc26aa40b88432a99904e9d049/users/0b3033247b984e5fbd25ea358410a7ec/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.810564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5e359-0b8b-4591-99bd-bfb3b8619c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d2e5cc26aa40b88432a99904e9d049, user_id=0b3033247b984e5fbd25ea358410a7ec, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:34.813682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5e359-0b8b-4591-99bd-bfb3b8619c38 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:35.078041 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1147/2289] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:34 2021] PUT /identity/v3/projects/79d2e5cc26aa40b88432a99904e9d049/users/0b3033247b984e5fbd25ea358410a7ec/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:35.078964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b61a36-04ca-4cdc-ab54-0c9109277c5a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:35.093992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b61a36-04ca-4cdc-ab54-0c9109277c5a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:35.260578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a896aa4-e448-4e85-bb5f-4260caf25cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:35.264496 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a896aa4-e448-4e85-bb5f-4260caf25cea admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:35.265006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a896aa4-e448-4e85-bb5f-4260caf25cea admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:35.265620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a896aa4-e448-4e85-bb5f-4260caf25cea admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:35.266580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a896aa4-e448-4e85-bb5f-4260caf25cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:35.269560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a896aa4-e448-4e85-bb5f-4260caf25cea admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:35.292260 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1143/2290] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:35.297315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5e359-0b8b-4591-99bd-bfb3b8619c38 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:35.316652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5e359-0b8b-4591-99bd-bfb3b8619c38 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:35.340293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ce022-318d-4b0f-ad95-fa39800077e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:35.340293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ce022-318d-4b0f-ad95-fa39800077e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:35.340293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ce022-318d-4b0f-ad95-fa39800077e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:35.340293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ce022-318d-4b0f-ad95-fa39800077e0 admin admin] PATH_INFO: `/v3/projects/79d2e5cc26aa40b88432a99904e9d049/users/0b3033247b984e5fbd25ea358410a7ec/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:35.340833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ce022-318d-4b0f-ad95-fa39800077e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d2e5cc26aa40b88432a99904e9d049, user_id=0b3033247b984e5fbd25ea358410a7ec, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:35.344293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ce022-318d-4b0f-ad95-fa39800077e0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:35.397802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1148/2291] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:35 2021] PUT /identity/v3/projects/79d2e5cc26aa40b88432a99904e9d049/users/0b3033247b984e5fbd25ea358410a7ec/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:37.573465 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a896aa4-e448-4e85-bb5f-4260caf25cea admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:37.575910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8a896aa4-e448-4e85-bb5f-4260caf25cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:37.592946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a896aa4-e448-4e85-bb5f-4260caf25cea admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:37.685637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:37.686536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:37.686833 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:37.687121 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] PATH_INFO: `/v3/users/7c45970aae3c4a8bb3dade382ec7532c` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:37.689521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c45970aae3c4a8bb3dade382ec7532c)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:37.702996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:37.898359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c45970aae3c4a8bb3dade382ec7532c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:37.914302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036145-3071-4398-83ea-db6c164bda81 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:37.916487 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036145-3071-4398-83ea-db6c164bda81 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:37.916487 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036145-3071-4398-83ea-db6c164bda81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:37.951395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c45970aae3c4a8bb3dade382ec7532c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:37.956915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c45970aae3c4a8bb3dade382ec7532c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:37.991295 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c45970aae3c4a8bb3dade382ec7532c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:38.009048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-9f036145-3071-4398-83ea-db6c164bda81 None None] MFA Rules not processed for user `0b3033247b984e5fbd25ea358410a7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:38.011314 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9f036145-3071-4398-83ea-db6c164bda81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:38.062058 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d16c6478-df0b-4de8-b854-09ab21196481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c45970aae3c4a8bb3dade382ec7532c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:38.070892 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1144/2292] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:37 2021] DELETE /identity/v3/users/7c45970aae3c4a8bb3dade382ec7532c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:38.075707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e27806-0aa4-4fa2-99d2-ce511450ca89 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:38.076612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e27806-0aa4-4fa2-99d2-ce511450ca89 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:38.077092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e27806-0aa4-4fa2-99d2-ce511450ca89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:38.107068 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b1e27806-0aa4-4fa2-99d2-ce511450ca89 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:38.108994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b1e27806-0aa4-4fa2-99d2-ce511450ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:38.204769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1149/2293] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:37 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:38.212643 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1145/2294] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:38.216783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f036145-3071-4398-83ea-db6c164bda81 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:38.218800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e27806-0aa4-4fa2-99d2-ce511450ca89 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:38.219219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9f036145-3071-4398-83ea-db6c164bda81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:38.222959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b1e27806-0aa4-4fa2-99d2-ce511450ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:38.361011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f036145-3071-4398-83ea-db6c164bda81 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:38.363309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e27806-0aa4-4fa2-99d2-ce511450ca89 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:38.373671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca4b1e-d2f7-4c3d-beb6-8ddcce5b2a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:38.374388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca4b1e-d2f7-4c3d-beb6-8ddcce5b2a65 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:38.376379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca4b1e-d2f7-4c3d-beb6-8ddcce5b2a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:38.376849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca4b1e-d2f7-4c3d-beb6-8ddcce5b2a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:38.381223 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c7ca4b1e-d2f7-4c3d-beb6-8ddcce5b2a65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:38.505843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb1337-f12f-41eb-823d-f57dfdaede15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:38.510444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb1337-f12f-41eb-823d-f57dfdaede15 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:38.510753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb1337-f12f-41eb-823d-f57dfdaede15 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:38.511039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb1337-f12f-41eb-823d-f57dfdaede15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:38.542214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca4b1e-d2f7-4c3d-beb6-8ddcce5b2a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:38.546314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca4b1e-d2f7-4c3d-beb6-8ddcce5b2a65 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:38.546825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb1337-f12f-41eb-823d-f57dfdaede15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:38.548612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb1337-f12f-41eb-823d-f57dfdaede15 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:38.564399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1150/2295] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:38.599290 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1146/2296] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:38 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:39.508198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb1337-f12f-41eb-823d-f57dfdaede15 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:39.510365 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8edb1337-f12f-41eb-823d-f57dfdaede15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:39.551172 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb1337-f12f-41eb-823d-f57dfdaede15 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:39.610158 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:39.612266 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:39.612948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:39.613470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] PATH_INFO: `/v3/projects/a5baed1823934de3b988bcab5d60602b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:39.615034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5baed1823934de3b988bcab5d60602b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:39.619718 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:40.264937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5baed1823934de3b988bcab5d60602b', 'request_id': 'req-446fd9f3-2226-4034-8fe6-dcac03f8aa84'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.754797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5baed1823934de3b988bcab5d60602b', 'request_id': 'req-446fd9f3-2226-4034-8fe6-dcac03f8aa84'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.787375 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5baed1823934de3b988bcab5d60602b', 'request_id': 'req-446fd9f3-2226-4034-8fe6-dcac03f8aa84'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.802004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] The token cache is being invalidate because project a5baed1823934de3b988bcab5d60602b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:40.802662 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.803673 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-446fd9f3-2226-4034-8fe6-dcac03f8aa84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.805494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1151/2297] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:39 2021] DELETE /identity/v3/projects/a5baed1823934de3b988bcab5d60602b => generated 0 bytes in 1298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:42.039386 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca4b1e-d2f7-4c3d-beb6-8ddcce5b2a65 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:42.050438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca4b1e-d2f7-4c3d-beb6-8ddcce5b2a65 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:42.144101 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df50b14-5873-4468-9666-25524431c016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:42.145301 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df50b14-5873-4468-9666-25524431c016 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:42.145814 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df50b14-5873-4468-9666-25524431c016 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:42.146297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df50b14-5873-4468-9666-25524431c016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:42.148589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0df50b14-5873-4468-9666-25524431c016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:42.224130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df50b14-5873-4468-9666-25524431c016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:42.226060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df50b14-5873-4468-9666-25524431c016 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:42.249920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1147/2298] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:42 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:47.994045 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027c0c5-9505-4cfd-948f-57a992e9c2fb None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:47.999134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027c0c5-9505-4cfd-948f-57a992e9c2fb None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:47.999134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027c0c5-9505-4cfd-948f-57a992e9c2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:48.027714 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0027c0c5-9505-4cfd-948f-57a992e9c2fb None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:48.029616 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0027c0c5-9505-4cfd-948f-57a992e9c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:48.087807 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1152/2299] 10.222.0.25 () {58 vars in 968 bytes} [Fri Aug 27 04:46:47 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:48.100619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df50b14-5873-4468-9666-25524431c016 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:48.102072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0df50b14-5873-4468-9666-25524431c016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:48.171389 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df50b14-5873-4468-9666-25524431c016 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:48.176668 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e7e70-4c7d-4376-9d12-e85d28a15b3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:48.186581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e7e70-4c7d-4376-9d12-e85d28a15b3c service swift] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:48.186581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e7e70-4c7d-4376-9d12-e85d28a15b3c service swift] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:48.186581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e7e70-4c7d-4376-9d12-e85d28a15b3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:48.187181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e7e70-4c7d-4376-9d12-e85d28a15b3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:48.189236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e7e70-4c7d-4376-9d12-e85d28a15b3c service swift] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:48.197779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1148/2300] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:46:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:52.041225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027c0c5-9505-4cfd-948f-57a992e9c2fb None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:52.043033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0027c0c5-9505-4cfd-948f-57a992e9c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:52.117418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027c0c5-9505-4cfd-948f-57a992e9c2fb None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:52.122553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:52.123416 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:52.123698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:52.123976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] PATH_INFO: `/v3/users/e87c6b2f12d04a6d8929e960e6268761` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:52.125219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87c6b2f12d04a6d8929e960e6268761)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:52.127302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:52.313279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87c6b2f12d04a6d8929e960e6268761'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:52.313279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87c6b2f12d04a6d8929e960e6268761'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:52.313279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87c6b2f12d04a6d8929e960e6268761'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:52.324169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87c6b2f12d04a6d8929e960e6268761'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:52.420180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87c6b2f12d04a6d8929e960e6268761'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:52.439138 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1153/2301] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:46:52 2021] DELETE /identity/v3/users/e87c6b2f12d04a6d8929e960e6268761 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:52.456733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8792b25-d145-476f-90ca-0d6c03443e6c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:52.457192 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8792b25-d145-476f-90ca-0d6c03443e6c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:52.457295 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8792b25-d145-476f-90ca-0d6c03443e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:52.490044 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e8792b25-d145-476f-90ca-0d6c03443e6c None None] MFA Rules not processed for user `541c688efdf8455c9a083ca11f2678be`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:52.492897 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e8792b25-d145-476f-90ca-0d6c03443e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:52.567939 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1149/2302] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:52 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:52.763539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:52.765695 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:52.850048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf599c5-0394-42c4-81f5-18a044871eff admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:52.854621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1adbc-c62e-42ae-95b2-26eaeb3f7c6b None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:52.855108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1adbc-c62e-42ae-95b2-26eaeb3f7c6b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:52.860281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:52.860675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1adbc-c62e-42ae-95b2-26eaeb3f7c6b None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:52.861273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:52.861560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:52.861928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] PATH_INFO: `/v3/projects/92b58305e4254a90a3ca4ad2b52756f5` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:52.863212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b58305e4254a90a3ca4ad2b52756f5)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:52.865812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:52.867431 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1150/2303] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 04:46:52 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:46:52.880488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df4146-893e-4316-b004-c8515bf4c3c1 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:52.880488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df4146-893e-4316-b004-c8515bf4c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:52.880759 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df4146-893e-4316-b004-c8515bf4c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:52.924801 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-07df4146-893e-4316-b004-c8515bf4c3c1 None None] MFA Rules not processed for user `6812bbce1050419ea721a9b648b87bef`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:52.926048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-07df4146-893e-4316-b004-c8515bf4c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:52.999890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1151/2304] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 04:46:52 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:53.012778 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df4146-893e-4316-b004-c8515bf4c3c1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:53.014852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-07df4146-893e-4316-b004-c8515bf4c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:53.016872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b58305e4254a90a3ca4ad2b52756f5', 'request_id': 'req-f76f32be-c323-4814-87ef-436f995dc63c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:53.071523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df4146-893e-4316-b004-c8515bf4c3c1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:53.086406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b58305e4254a90a3ca4ad2b52756f5', 'request_id': 'req-f76f32be-c323-4814-87ef-436f995dc63c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:53.089380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b58305e4254a90a3ca4ad2b52756f5', 'request_id': 'req-f76f32be-c323-4814-87ef-436f995dc63c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:53.102034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] The token cache is being invalidate because project 92b58305e4254a90a3ca4ad2b52756f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:53.102331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:53.103042 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f76f32be-c323-4814-87ef-436f995dc63c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:53.109922 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1154/2305] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:46:52 2021] DELETE /identity/v3/projects/92b58305e4254a90a3ca4ad2b52756f5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:53.111737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a61c65-d28e-4b37-9acc-9fe35fcffeff None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.112076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a61c65-d28e-4b37-9acc-9fe35fcffeff None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.112383 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a61c65-d28e-4b37-9acc-9fe35fcffeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.126368 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85031-46e3-4166-90fc-df848a1f1bc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f041d8d6b5949c48920b729511f3783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:53.127064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85031-46e3-4166-90fc-df848a1f1bc3 service glance] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.127351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85031-46e3-4166-90fc-df848a1f1bc3 service glance] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.127633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85031-46e3-4166-90fc-df848a1f1bc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.129575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-32c85031-46e3-4166-90fc-df848a1f1bc3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:53.132651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-08a61c65-d28e-4b37-9acc-9fe35fcffeff None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:53.133943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-08a61c65-d28e-4b37-9acc-9fe35fcffeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:53.200418 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1155/2306] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:53.208015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095593f-24c7-43d5-8d93-f8b75415961d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.208297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095593f-24c7-43d5-8d93-f8b75415961d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.208601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095593f-24c7-43d5-8d93-f8b75415961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.210279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c85031-46e3-4166-90fc-df848a1f1bc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:53.211986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c85031-46e3-4166-90fc-df848a1f1bc3 service glance] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:53.227307 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7095593f-24c7-43d5-8d93-f8b75415961d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:53.227775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1152/2307] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:53.229240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7095593f-24c7-43d5-8d93-f8b75415961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:53.239215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1156/2308] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:53.243437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85031-46e3-4166-90fc-df848a1f1bc3 service glance] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:53.263994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85031-46e3-4166-90fc-df848a1f1bc3 service glance] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:53.269323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7dbcf-9a62-4a0a-a77d-5935ece7ce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:53.270003 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7dbcf-9a62-4a0a-a77d-5935ece7ce8f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.270287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7dbcf-9a62-4a0a-a77d-5935ece7ce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.270567 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7dbcf-9a62-4a0a-a77d-5935ece7ce8f admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.271378 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7dbcf-9a62-4a0a-a77d-5935ece7ce8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:53.271694 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7dbcf-9a62-4a0a-a77d-5935ece7ce8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:53.273339 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7dbcf-9a62-4a0a-a77d-5935ece7ce8f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:53.286576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1153/2309] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:46:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:53.303516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095593f-24c7-43d5-8d93-f8b75415961d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:53.314638 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095593f-24c7-43d5-8d93-f8b75415961d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:53.325840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80029029-744d-4659-9877-e7b58a7488dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:53.326072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029029-744d-4659-9877-e7b58a7488dd admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.326387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029029-744d-4659-9877-e7b58a7488dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.326664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029029-744d-4659-9877-e7b58a7488dd admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.327368 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80029029-744d-4659-9877-e7b58a7488dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:53.330156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80029029-744d-4659-9877-e7b58a7488dd admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:53.450618 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1157/2310] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:46:53 2021] POST /identity/v3/projects => generated 399 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:53.455015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7dbcf-9a62-4a0a-a77d-5935ece7ce8f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:53.465961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7dbcf-9a62-4a0a-a77d-5935ece7ce8f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:53.521905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b4710-c896-465f-a357-ecd116e522ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:53.522575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b4710-c896-465f-a357-ecd116e522ab admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.522855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b4710-c896-465f-a357-ecd116e522ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.523131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b4710-c896-465f-a357-ecd116e522ab admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.523819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b4710-c896-465f-a357-ecd116e522ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:53.525755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b4710-c896-465f-a357-ecd116e522ab admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:53.540210 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bae19f-503f-4b11-ba8f-2234e2cf686c None None] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.541049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bae19f-503f-4b11-ba8f-2234e2cf686c None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.541049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bae19f-503f-4b11-ba8f-2234e2cf686c None None] PATH_INFO: `/` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.543636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1158/2311] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 04:46:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:46:53.548199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f377e22-e485-437f-baf0-6c8b58a314f0 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.548593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f377e22-e485-437f-baf0-6c8b58a314f0 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.548978 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f377e22-e485-437f-baf0-6c8b58a314f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.567685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-1f377e22-e485-437f-baf0-6c8b58a314f0 None None] MFA Rules not processed for user `a95d2eadd8c7455bb70477e4522c74c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:53.569038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1f377e22-e485-437f-baf0-6c8b58a314f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:53.630295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1159/2312] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 04:46:53 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:53.644034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f377e22-e485-437f-baf0-6c8b58a314f0 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:53.645989 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1f377e22-e485-437f-baf0-6c8b58a314f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:53.648906 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1154/2313] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:46:53 2021] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:53.653625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b4710-c896-465f-a357-ecd116e522ab admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:53.658457 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f377e22-e485-437f-baf0-6c8b58a314f0 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:53.671315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106e7a5-2b92-492a-a613-733ba7afc618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:53.671315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e7a5-2b92-492a-a613-733ba7afc618 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.671517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b4710-c896-465f-a357-ecd116e522ab admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:53.671609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e7a5-2b92-492a-a613-733ba7afc618 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.671609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e7a5-2b92-492a-a613-733ba7afc618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.676015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0da062-aab4-43bf-bb0b-55227556cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:53.677359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da062-aab4-43bf-bb0b-55227556cdfd admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.677831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da062-aab4-43bf-bb0b-55227556cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.678275 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da062-aab4-43bf-bb0b-55227556cdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.679943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0da062-aab4-43bf-bb0b-55227556cdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:53.681959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0da062-aab4-43bf-bb0b-55227556cdfd admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:53.682265 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106e7a5-2b92-492a-a613-733ba7afc618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:53.684219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106e7a5-2b92-492a-a613-733ba7afc618 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:53.693773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1155/2314] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:53 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:53.697963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0da062-aab4-43bf-bb0b-55227556cdfd admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:53.700523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1160/2315] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:53 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:46:53.708882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0da062-aab4-43bf-bb0b-55227556cdfd admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:53.715246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33db54e-170e-4ead-b2ce-40df83335648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:53.720516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db54e-170e-4ead-b2ce-40df83335648 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.720516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db54e-170e-4ead-b2ce-40df83335648 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.720516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db54e-170e-4ead-b2ce-40df83335648 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.720516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33db54e-170e-4ead-b2ce-40df83335648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:53.720516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33db54e-170e-4ead-b2ce-40df83335648 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:53.736164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1156/2316] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:46:53 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:53.736769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106e7a5-2b92-492a-a613-733ba7afc618 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:53.753346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106e7a5-2b92-492a-a613-733ba7afc618 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:53.764835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540023c-3686-4e73-95ff-a710923f5ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:53.765623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540023c-3686-4e73-95ff-a710923f5ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.766082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540023c-3686-4e73-95ff-a710923f5ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.766309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540023c-3686-4e73-95ff-a710923f5ab3 admin admin] PATH_INFO: `/v3/projects/05d1173df8ee4fd0ae93b04f3b414ac2/users/1bb6790b662442ee863c0d2d8e337475/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.784098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540023c-3686-4e73-95ff-a710923f5ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d1173df8ee4fd0ae93b04f3b414ac2, user_id=1bb6790b662442ee863c0d2d8e337475, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:53.787007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540023c-3686-4e73-95ff-a710923f5ab3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:53.908453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1161/2317] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:46:53 2021] PUT /identity/v3/projects/05d1173df8ee4fd0ae93b04f3b414ac2/users/1bb6790b662442ee863c0d2d8e337475/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:53.921478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8940a-074e-45e7-818d-84a033ea17b1 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.926128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8940a-074e-45e7-818d-84a033ea17b1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.926128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8940a-074e-45e7-818d-84a033ea17b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.986678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-29e8940a-074e-45e7-818d-84a033ea17b1 None None] MFA Rules not processed for user `1bb6790b662442ee863c0d2d8e337475`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:53.988016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-29e8940a-074e-45e7-818d-84a033ea17b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:54.094674 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1157/2318] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:46:53 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:54.106343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540023c-3686-4e73-95ff-a710923f5ab3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:54.111726 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a540023c-3686-4e73-95ff-a710923f5ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:54.202767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540023c-3686-4e73-95ff-a710923f5ab3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:54.206727 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967a09f-1498-452e-af27-c8d381e5c293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:54.207451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a09f-1498-452e-af27-c8d381e5c293 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:54.207799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a09f-1498-452e-af27-c8d381e5c293 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:54.208081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a09f-1498-452e-af27-c8d381e5c293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:54.219280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967a09f-1498-452e-af27-c8d381e5c293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:54.220802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967a09f-1498-452e-af27-c8d381e5c293 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:54.234079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1162/2319] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:46:54 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:01.715944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d469ce9-0a75-4c4a-a348-a8384014eda5 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:01.716435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d469ce9-0a75-4c4a-a348-a8384014eda5 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:01.716563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d469ce9-0a75-4c4a-a348-a8384014eda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:01.736276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-1d469ce9-0a75-4c4a-a348-a8384014eda5 None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:01.737620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1d469ce9-0a75-4c4a-a348-a8384014eda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:01.804775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1158/2320] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:47:01 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:01.859869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967a09f-1498-452e-af27-c8d381e5c293 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:01.859869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c967a09f-1498-452e-af27-c8d381e5c293 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:01.928229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967a09f-1498-452e-af27-c8d381e5c293 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:01.934363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6ac79-38ef-4d20-891a-2cdb6104db24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:01.935373 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6ac79-38ef-4d20-891a-2cdb6104db24 service swift] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:01.935862 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6ac79-38ef-4d20-891a-2cdb6104db24 service swift] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:01.936291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6ac79-38ef-4d20-891a-2cdb6104db24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:01.947081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6ac79-38ef-4d20-891a-2cdb6104db24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:01.948981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6ac79-38ef-4d20-891a-2cdb6104db24 service swift] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:01.958947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1163/2321] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:47:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:47:03.825716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d469ce9-0a75-4c4a-a348-a8384014eda5 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:03.828154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1d469ce9-0a75-4c4a-a348-a8384014eda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:03.927659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d469ce9-0a75-4c4a-a348-a8384014eda5 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:03.933006 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:03.934252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:03.934690 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:03.935115 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] PATH_INFO: `/v3/users/27a3d5fb401f47d28ba6af0da24cc128` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:03.936602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a3d5fb401f47d28ba6af0da24cc128)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:03.938529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.090701 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a3d5fb401f47d28ba6af0da24cc128'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.103891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a3d5fb401f47d28ba6af0da24cc128'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.105548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a3d5fb401f47d28ba6af0da24cc128'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.116928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a3d5fb401f47d28ba6af0da24cc128'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.172876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a3d5fb401f47d28ba6af0da24cc128'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.174962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6ac79-38ef-4d20-891a-2cdb6104db24 service swift] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.180319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1159/2322] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:47:03 2021] DELETE /identity/v3/users/27a3d5fb401f47d28ba6af0da24cc128 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:04.187290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6ac79-38ef-4d20-891a-2cdb6104db24 service swift] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.265719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.266650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.266932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.267208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] PATH_INFO: `/v3/users/1bb6790b662442ee863c0d2d8e337475` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.268508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb6790b662442ee863c0d2d8e337475)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.271238 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.432617 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.434438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:04.450797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a9bc0-34e8-456a-ae21-53e494d4ab81 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.456316 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.457516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.457738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.458050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] PATH_INFO: `/v3/projects/617153db413a41c4b476f446794cb806` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.459908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] RBAC: Authorizing `identity:delete_project(project_id=617153db413a41c4b476f446794cb806)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.461720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.505305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb6790b662442ee863c0d2d8e337475'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.506205 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb6790b662442ee863c0d2d8e337475'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.507228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb6790b662442ee863c0d2d8e337475'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.553234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb6790b662442ee863c0d2d8e337475'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.581566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '617153db413a41c4b476f446794cb806', 'request_id': 'req-571d8077-46c6-4149-a23c-e0c9a1b082de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.614456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '617153db413a41c4b476f446794cb806', 'request_id': 'req-571d8077-46c6-4149-a23c-e0c9a1b082de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.614456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '617153db413a41c4b476f446794cb806', 'request_id': 'req-571d8077-46c6-4149-a23c-e0c9a1b082de'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.647328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-dc340989-1299-4950-8ffc-3c6b9adb3dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb6790b662442ee863c0d2d8e337475'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.670438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1164/2323] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:47:04 2021] DELETE /identity/v3/users/1bb6790b662442ee863c0d2d8e337475 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:04.675057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c25ca-5285-4f01-b6f2-db84493f1004 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.675355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c25ca-5285-4f01-b6f2-db84493f1004 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.675648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c25ca-5285-4f01-b6f2-db84493f1004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.707858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-778c25ca-5285-4f01-b6f2-db84493f1004 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:04.709351 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-778c25ca-5285-4f01-b6f2-db84493f1004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:04.756900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] The token cache is being invalidate because project 617153db413a41c4b476f446794cb806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:04.757225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.758123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.763208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1160/2324] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:47:04 2021] DELETE /identity/v3/projects/617153db413a41c4b476f446794cb806 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:04.764691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.766202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:04.792107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1165/2325] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:04.803838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c25ca-5285-4f01-b6f2-db84493f1004 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.805289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-778c25ca-5285-4f01-b6f2-db84493f1004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:04.853738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d8077-46c6-4149-a23c-e0c9a1b082de admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.863811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.864725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.865001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.872310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] PATH_INFO: `/v3/users/0b3033247b984e5fbd25ea358410a7ec` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.872310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3033247b984e5fbd25ea358410a7ec)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.872310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.894168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c25ca-5285-4f01-b6f2-db84493f1004 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.898716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496897c7-daae-4504-938e-4adb9cf9fc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.899432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496897c7-daae-4504-938e-4adb9cf9fc29 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.899648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496897c7-daae-4504-938e-4adb9cf9fc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.899930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496897c7-daae-4504-938e-4adb9cf9fc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.910322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496897c7-daae-4504-938e-4adb9cf9fc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.911768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496897c7-daae-4504-938e-4adb9cf9fc29 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.921356 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1166/2326] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:05.120827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3033247b984e5fbd25ea358410a7ec'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.134950 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3033247b984e5fbd25ea358410a7ec'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.135878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3033247b984e5fbd25ea358410a7ec'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.144805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3033247b984e5fbd25ea358410a7ec'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.219166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3033247b984e5fbd25ea358410a7ec'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.227407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1161/2327] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:47:04 2021] DELETE /identity/v3/users/0b3033247b984e5fbd25ea358410a7ec => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:05.448987 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496897c7-daae-4504-938e-4adb9cf9fc29 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.450425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-496897c7-daae-4504-938e-4adb9cf9fc29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:05.464903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496897c7-daae-4504-938e-4adb9cf9fc29 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.513940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.515508 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:05.545288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.547386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.547386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.557064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] PATH_INFO: `/v3/projects/05d1173df8ee4fd0ae93b04f3b414ac2` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.558765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d1173df8ee4fd0ae93b04f3b414ac2)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.561274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.592320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4763-627d-4a5a-bc02-2455b0b1011d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.597487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.598385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.598640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.598993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] PATH_INFO: `/v3/projects/79d2e5cc26aa40b88432a99904e9d049` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.600340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d2e5cc26aa40b88432a99904e9d049)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.602228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.682836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d1173df8ee4fd0ae93b04f3b414ac2', 'request_id': 'req-96fa0108-499b-4f7e-b8a1-e1336c6af951'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.751998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d2e5cc26aa40b88432a99904e9d049', 'request_id': 'req-7c4d2025-5b9a-427a-9549-262ddbd6eccb'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.756698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d1173df8ee4fd0ae93b04f3b414ac2', 'request_id': 'req-96fa0108-499b-4f7e-b8a1-e1336c6af951'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.764975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d1173df8ee4fd0ae93b04f3b414ac2', 'request_id': 'req-96fa0108-499b-4f7e-b8a1-e1336c6af951'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.767118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d2e5cc26aa40b88432a99904e9d049', 'request_id': 'req-7c4d2025-5b9a-427a-9549-262ddbd6eccb'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.777231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d2e5cc26aa40b88432a99904e9d049', 'request_id': 'req-7c4d2025-5b9a-427a-9549-262ddbd6eccb'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.787826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] The token cache is being invalidate because project 05d1173df8ee4fd0ae93b04f3b414ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:05.788279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.796538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96fa0108-499b-4f7e-b8a1-e1336c6af951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.796538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1167/2328] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:47:05 2021] DELETE /identity/v3/projects/05d1173df8ee4fd0ae93b04f3b414ac2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:05.801636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209351c-4ef7-4c7e-9824-b8d03e0d8ffb None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.802025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209351c-4ef7-4c7e-9824-b8d03e0d8ffb None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.802723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209351c-4ef7-4c7e-9824-b8d03e0d8ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.829718 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-4209351c-4ef7-4c7e-9824-b8d03e0d8ffb None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:05.831281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4209351c-4ef7-4c7e-9824-b8d03e0d8ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:05.852748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] The token cache is being invalidate because project 79d2e5cc26aa40b88432a99904e9d049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:05.853310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.854382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7c4d2025-5b9a-427a-9549-262ddbd6eccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:05.856913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1162/2329] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:47:05 2021] DELETE /identity/v3/projects/79d2e5cc26aa40b88432a99904e9d049 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:05.864549 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f7c9-0569-49ec-8ba4-bfc00043c2a1 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.865139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f7c9-0569-49ec-8ba4-bfc00043c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.865422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f7c9-0569-49ec-8ba4-bfc00043c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.889087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-6dc7f7c9-0569-49ec-8ba4-bfc00043c2a1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:05.890342 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6dc7f7c9-0569-49ec-8ba4-bfc00043c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:05.979062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1168/2330] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:05.985898 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399879d5-a52e-491e-b422-8df8f8aa2c74 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.986102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399879d5-a52e-491e-b422-8df8f8aa2c74 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.986378 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399879d5-a52e-491e-b422-8df8f8aa2c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.031747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-399879d5-a52e-491e-b422-8df8f8aa2c74 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:06.033106 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1163/2331] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:06.037477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-399879d5-a52e-491e-b422-8df8f8aa2c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:06.041674 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2925d-1ecf-48a5-8f71-ec60dd400630 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.042443 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2925d-1ecf-48a5-8f71-ec60dd400630 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.042932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2925d-1ecf-48a5-8f71-ec60dd400630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.067976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1169/2332] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:06.069105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399879d5-a52e-491e-b422-8df8f8aa2c74 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.080445 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399879d5-a52e-491e-b422-8df8f8aa2c74 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.082706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-30b2925d-1ecf-48a5-8f71-ec60dd400630 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:06.084002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-30b2925d-1ecf-48a5-8f71-ec60dd400630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:06.085574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974ae8-5c27-470e-9f5b-032e3af90b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.086317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974ae8-5c27-470e-9f5b-032e3af90b1a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.086690 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974ae8-5c27-470e-9f5b-032e3af90b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.087044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974ae8-5c27-470e-9f5b-032e3af90b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.087854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8974ae8-5c27-470e-9f5b-032e3af90b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:06.088235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8974ae8-5c27-470e-9f5b-032e3af90b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.090260 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8974ae8-5c27-470e-9f5b-032e3af90b1a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.093580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1164/2333] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:06.102943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2925d-1ecf-48a5-8f71-ec60dd400630 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.105388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1170/2334] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:47:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:06.109977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974ae8-5c27-470e-9f5b-032e3af90b1a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.112997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2925d-1ecf-48a5-8f71-ec60dd400630 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.121082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81841bb5-1b95-4c32-b252-e6ead074a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.121082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81841bb5-1b95-4c32-b252-e6ead074a1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.121082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81841bb5-1b95-4c32-b252-e6ead074a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.121082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81841bb5-1b95-4c32-b252-e6ead074a1c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.122320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974ae8-5c27-470e-9f5b-032e3af90b1a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.122449 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81841bb5-1b95-4c32-b252-e6ead074a1c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:06.122631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81841bb5-1b95-4c32-b252-e6ead074a1c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.124524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81841bb5-1b95-4c32-b252-e6ead074a1c8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.127906 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c389-eeca-41a6-bd25-0265dc548098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.128747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c389-eeca-41a6-bd25-0265dc548098 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.129327 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c389-eeca-41a6-bd25-0265dc548098 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.129710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c389-eeca-41a6-bd25-0265dc548098 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.130518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903c389-eeca-41a6-bd25-0265dc548098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.132771 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903c389-eeca-41a6-bd25-0265dc548098 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.143027 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1165/2335] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:47:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:47:06.147318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81841bb5-1b95-4c32-b252-e6ead074a1c8 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.157955 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81841bb5-1b95-4c32-b252-e6ead074a1c8 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.164179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550317b5-94fc-47ff-8621-1c401ac9c9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.165563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550317b5-94fc-47ff-8621-1c401ac9c9fa admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.165563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550317b5-94fc-47ff-8621-1c401ac9c9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.165768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550317b5-94fc-47ff-8621-1c401ac9c9fa admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.166819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550317b5-94fc-47ff-8621-1c401ac9c9fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.169046 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550317b5-94fc-47ff-8621-1c401ac9c9fa admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.227646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1171/2336] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:06 2021] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:06.232038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c389-eeca-41a6-bd25-0265dc548098 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.272229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1166/2337] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:06 2021] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:06.276752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550317b5-94fc-47ff-8621-1c401ac9c9fa admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.341503 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c389-eeca-41a6-bd25-0265dc548098 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.371032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550317b5-94fc-47ff-8621-1c401ac9c9fa admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.376990 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73738d1a-b1f4-4648-be08-69eea779be73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.377674 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73738d1a-b1f4-4648-be08-69eea779be73 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.377958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73738d1a-b1f4-4648-be08-69eea779be73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.378234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73738d1a-b1f4-4648-be08-69eea779be73 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.379105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73738d1a-b1f4-4648-be08-69eea779be73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.381181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73738d1a-b1f4-4648-be08-69eea779be73 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.415872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03fc96-3159-4a3d-96a1-8b2a400a406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.416892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03fc96-3159-4a3d-96a1-8b2a400a406f admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.417838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03fc96-3159-4a3d-96a1-8b2a400a406f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.418410 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03fc96-3159-4a3d-96a1-8b2a400a406f admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.419264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03fc96-3159-4a3d-96a1-8b2a400a406f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.421568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03fc96-3159-4a3d-96a1-8b2a400a406f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.459182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1167/2338] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:47:06 2021] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:06.467632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73738d1a-b1f4-4648-be08-69eea779be73 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.477622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73738d1a-b1f4-4648-be08-69eea779be73 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.483161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc75a-f2a9-4db2-b840-d49f53cd1f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.483850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc75a-f2a9-4db2-b840-d49f53cd1f1d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.484155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc75a-f2a9-4db2-b840-d49f53cd1f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.484461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc75a-f2a9-4db2-b840-d49f53cd1f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.485237 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fc75a-f2a9-4db2-b840-d49f53cd1f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.486891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fc75a-f2a9-4db2-b840-d49f53cd1f1d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.497807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1168/2339] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:06.501722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc75a-f2a9-4db2-b840-d49f53cd1f1d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.512097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc75a-f2a9-4db2-b840-d49f53cd1f1d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.517251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeb040-bdd7-4208-a0ac-16ceb76094ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.517933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeb040-bdd7-4208-a0ac-16ceb76094ff admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.518219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeb040-bdd7-4208-a0ac-16ceb76094ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.518645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeb040-bdd7-4208-a0ac-16ceb76094ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.519392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aeb040-bdd7-4208-a0ac-16ceb76094ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.521058 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aeb040-bdd7-4208-a0ac-16ceb76094ff admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.521716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1172/2340] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:47:06 2021] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:06.525759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03fc96-3159-4a3d-96a1-8b2a400a406f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.536693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1169/2341] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:06.537288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03fc96-3159-4a3d-96a1-8b2a400a406f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.541383 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeb040-bdd7-4208-a0ac-16ceb76094ff admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.543146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb083c-51c8-4067-a843-6b4d458a9b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.543831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb083c-51c8-4067-a843-6b4d458a9b5a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.544111 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb083c-51c8-4067-a843-6b4d458a9b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.544407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb083c-51c8-4067-a843-6b4d458a9b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.545151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb083c-51c8-4067-a843-6b4d458a9b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.546761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb083c-51c8-4067-a843-6b4d458a9b5a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.555621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeb040-bdd7-4208-a0ac-16ceb76094ff admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.559538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1173/2342] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:06 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:06.563072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb083c-51c8-4067-a843-6b4d458a9b5a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.564645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ae8ac-d436-4a78-a360-6cf896ccc10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.565737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ae8ac-d436-4a78-a360-6cf896ccc10c admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.566019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ae8ac-d436-4a78-a360-6cf896ccc10c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.566307 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ae8ac-d436-4a78-a360-6cf896ccc10c admin admin] PATH_INFO: `/v3/projects/f16a076145004b32822d45fcd86ea51e/users/c8fb38afffe4417ab9f3617228c4bde6/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.573529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb083c-51c8-4067-a843-6b4d458a9b5a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.578568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62858cad-8b0c-4b71-a345-3004a2f11714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.579241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62858cad-8b0c-4b71-a345-3004a2f11714 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.579539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62858cad-8b0c-4b71-a345-3004a2f11714 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.579813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62858cad-8b0c-4b71-a345-3004a2f11714 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.580601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62858cad-8b0c-4b71-a345-3004a2f11714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.582349 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62858cad-8b0c-4b71-a345-3004a2f11714 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.583688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ae8ac-d436-4a78-a360-6cf896ccc10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16a076145004b32822d45fcd86ea51e, user_id=c8fb38afffe4417ab9f3617228c4bde6, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.586349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ae8ac-d436-4a78-a360-6cf896ccc10c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.593312 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1174/2343] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:06.601459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62858cad-8b0c-4b71-a345-3004a2f11714 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.616164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62858cad-8b0c-4b71-a345-3004a2f11714 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.621437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c38bf0-af2e-4091-a338-5a0fcae3259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.622341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c38bf0-af2e-4091-a338-5a0fcae3259a admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.622623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c38bf0-af2e-4091-a338-5a0fcae3259a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.622928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c38bf0-af2e-4091-a338-5a0fcae3259a admin admin] PATH_INFO: `/v3/projects/55642c30419042daa27ecdcf76f4e6a5/users/2bf313c2f1894c7b97d50c9afa8666b3/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.638225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c38bf0-af2e-4091-a338-5a0fcae3259a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55642c30419042daa27ecdcf76f4e6a5, user_id=2bf313c2f1894c7b97d50c9afa8666b3, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.640983 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c38bf0-af2e-4091-a338-5a0fcae3259a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.677130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1170/2344] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:06 2021] PUT /identity/v3/projects/f16a076145004b32822d45fcd86ea51e/users/c8fb38afffe4417ab9f3617228c4bde6/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:06.694014 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a3f52-42d8-464b-8e9a-99c58a55290b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.694383 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a3f52-42d8-464b-8e9a-99c58a55290b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.694622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a3f52-42d8-464b-8e9a-99c58a55290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.723841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-109a3f52-42d8-464b-8e9a-99c58a55290b None None] MFA Rules not processed for user `c8fb38afffe4417ab9f3617228c4bde6`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:06.725111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-109a3f52-42d8-464b-8e9a-99c58a55290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:06.730586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1175/2345] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:06 2021] PUT /identity/v3/projects/55642c30419042daa27ecdcf76f4e6a5/users/2bf313c2f1894c7b97d50c9afa8666b3/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:06.735477 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa43df4-c350-4354-8224-f12444cecb4b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.735770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa43df4-c350-4354-8224-f12444cecb4b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.736448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa43df4-c350-4354-8224-f12444cecb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.754440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-9aa43df4-c350-4354-8224-f12444cecb4b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:06.755811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9aa43df4-c350-4354-8224-f12444cecb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:06.813382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1171/2346] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:06 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:06.818100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a3f52-42d8-464b-8e9a-99c58a55290b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.823781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1176/2347] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:06.832726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a3f52-42d8-464b-8e9a-99c58a55290b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.834688 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa43df4-c350-4354-8224-f12444cecb4b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.836073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9aa43df4-c350-4354-8224-f12444cecb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:06.837853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef1020-359c-4c0a-8fdf-5cc68b799494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.838720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef1020-359c-4c0a-8fdf-5cc68b799494 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.839655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef1020-359c-4c0a-8fdf-5cc68b799494 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.840002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef1020-359c-4c0a-8fdf-5cc68b799494 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.840876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef1020-359c-4c0a-8fdf-5cc68b799494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.857201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef1020-359c-4c0a-8fdf-5cc68b799494 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.940019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa43df4-c350-4354-8224-f12444cecb4b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.943990 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6072f-e884-4135-8066-3f9e4fb3ba23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.944740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6072f-e884-4135-8066-3f9e4fb3ba23 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.945045 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6072f-e884-4135-8066-3f9e4fb3ba23 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.945317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6072f-e884-4135-8066-3f9e4fb3ba23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.955136 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6072f-e884-4135-8066-3f9e4fb3ba23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.956659 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6072f-e884-4135-8066-3f9e4fb3ba23 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.969209 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1177/2348] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:06.986623 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1172/2349] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:06 2021] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:06.993183 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6072f-e884-4135-8066-3f9e4fb3ba23 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.008325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6072f-e884-4135-8066-3f9e4fb3ba23 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:07.113858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887ad75-671d-465f-a70f-7c4afe6ac6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:07.114563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887ad75-671d-465f-a70f-7c4afe6ac6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:07.114846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887ad75-671d-465f-a70f-7c4afe6ac6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:07.115128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887ad75-671d-465f-a70f-7c4afe6ac6a1 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:07.115829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887ad75-671d-465f-a70f-7c4afe6ac6a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:07.117800 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887ad75-671d-465f-a70f-7c4afe6ac6a1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:07.225324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1178/2350] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:47:06 2021] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:07.229853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef1020-359c-4c0a-8fdf-5cc68b799494 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.250212 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef1020-359c-4c0a-8fdf-5cc68b799494 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:07.259807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09da43-6fd6-4759-90c9-fb7596a7ccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:07.261655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09da43-6fd6-4759-90c9-fb7596a7ccc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:07.262408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09da43-6fd6-4759-90c9-fb7596a7ccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:07.262905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09da43-6fd6-4759-90c9-fb7596a7ccc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:07.264163 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09da43-6fd6-4759-90c9-fb7596a7ccc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:07.265985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09da43-6fd6-4759-90c9-fb7596a7ccc3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:07.280456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1173/2351] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:07 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:07.284157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887ad75-671d-465f-a70f-7c4afe6ac6a1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.304282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887ad75-671d-465f-a70f-7c4afe6ac6a1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:07.311545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346ec10-b156-4ef6-ad32-035baeecae35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:07.312500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346ec10-b156-4ef6-ad32-035baeecae35 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:07.312957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346ec10-b156-4ef6-ad32-035baeecae35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:07.313412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346ec10-b156-4ef6-ad32-035baeecae35 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:07.314458 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346ec10-b156-4ef6-ad32-035baeecae35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:07.316493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346ec10-b156-4ef6-ad32-035baeecae35 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:07.341379 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1179/2352] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:07 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:07.345470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09da43-6fd6-4759-90c9-fb7596a7ccc3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.430232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09da43-6fd6-4759-90c9-fb7596a7ccc3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:07.430232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82ff5-03b0-4389-ae54-17433227e0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:07.430232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82ff5-03b0-4389-ae54-17433227e0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:07.430232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82ff5-03b0-4389-ae54-17433227e0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:07.430983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82ff5-03b0-4389-ae54-17433227e0ce admin admin] PATH_INFO: `/v3/projects/64c10b8abbf9465aa12809d4a1c015e3/users/0018814ec9604fa1ab2112d8b005e42c/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:07.430983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd82ff5-03b0-4389-ae54-17433227e0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c10b8abbf9465aa12809d4a1c015e3, user_id=0018814ec9604fa1ab2112d8b005e42c, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:07.430983 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd82ff5-03b0-4389-ae54-17433227e0ce admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.279393 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1174/2353] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:07 2021] PUT /identity/v3/projects/64c10b8abbf9465aa12809d4a1c015e3/users/0018814ec9604fa1ab2112d8b005e42c/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:08.303519 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0ea03-cf94-46db-a643-e2f7011baffb None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.303519 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0ea03-cf94-46db-a643-e2f7011baffb None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.303519 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0ea03-cf94-46db-a643-e2f7011baffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.336489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-bbf0ea03-cf94-46db-a643-e2f7011baffb None None] MFA Rules not processed for user `0018814ec9604fa1ab2112d8b005e42c`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:08.338306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-bbf0ea03-cf94-46db-a643-e2f7011baffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:08.531258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1180/2354] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:08 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:08.531579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82ff5-03b0-4389-ae54-17433227e0ce admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:08.667755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82ff5-03b0-4389-ae54-17433227e0ce admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:08.674082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180adfd-989d-4d1f-bc92-cb1ac83e2321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:08.674082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180adfd-989d-4d1f-bc92-cb1ac83e2321 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.674082 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180adfd-989d-4d1f-bc92-cb1ac83e2321 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.674689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180adfd-989d-4d1f-bc92-cb1ac83e2321 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.683075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180adfd-989d-4d1f-bc92-cb1ac83e2321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:08.685350 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180adfd-989d-4d1f-bc92-cb1ac83e2321 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.913594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1175/2355] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:08 2021] POST /identity/v3/projects => generated 375 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:08.917309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0ea03-cf94-46db-a643-e2f7011baffb None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:08.931754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0ea03-cf94-46db-a643-e2f7011baffb None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:09.001920 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751907-be3d-4583-827c-1dbd0f62469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:09.003031 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751907-be3d-4583-827c-1dbd0f62469b admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:09.003514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751907-be3d-4583-827c-1dbd0f62469b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:09.003987 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751907-be3d-4583-827c-1dbd0f62469b admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:09.005263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751907-be3d-4583-827c-1dbd0f62469b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:09.008915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751907-be3d-4583-827c-1dbd0f62469b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:09.221520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1181/2356] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:47:08 2021] POST /identity/v3/users => generated 294 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:09.224215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180adfd-989d-4d1f-bc92-cb1ac83e2321 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:09.235773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180adfd-989d-4d1f-bc92-cb1ac83e2321 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:09.240671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ffb23-5214-4791-9ec8-aa845a017959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:09.241332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ffb23-5214-4791-9ec8-aa845a017959 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:09.241613 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ffb23-5214-4791-9ec8-aa845a017959 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:09.241887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ffb23-5214-4791-9ec8-aa845a017959 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:09.242607 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ffb23-5214-4791-9ec8-aa845a017959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:09.244199 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ffb23-5214-4791-9ec8-aa845a017959 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:09.256688 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1176/2357] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:09 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:09.261130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751907-be3d-4583-827c-1dbd0f62469b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:09.271750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751907-be3d-4583-827c-1dbd0f62469b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:09.276889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08119e8-ffd4-4879-83cb-be7e514f2204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:09.279416 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08119e8-ffd4-4879-83cb-be7e514f2204 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:09.279416 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08119e8-ffd4-4879-83cb-be7e514f2204 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:09.279416 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08119e8-ffd4-4879-83cb-be7e514f2204 admin admin] PATH_INFO: `/v3/projects/83f2d9789e9145769aa24d0166575e52/users/887eaae9d3e54725bff2b7ccfb041b53/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:09.294883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08119e8-ffd4-4879-83cb-be7e514f2204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f2d9789e9145769aa24d0166575e52, user_id=887eaae9d3e54725bff2b7ccfb041b53, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:09.299282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08119e8-ffd4-4879-83cb-be7e514f2204 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:09.708546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1182/2358] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:09 2021] PUT /identity/v3/projects/83f2d9789e9145769aa24d0166575e52/users/887eaae9d3e54725bff2b7ccfb041b53/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:09.712726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ffb23-5214-4791-9ec8-aa845a017959 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:09.732062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ffb23-5214-4791-9ec8-aa845a017959 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:09.883266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573f16e-cd07-4219-a14b-e927a7ec267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:09.884522 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573f16e-cd07-4219-a14b-e927a7ec267b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:09.885172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573f16e-cd07-4219-a14b-e927a7ec267b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:09.885589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573f16e-cd07-4219-a14b-e927a7ec267b admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:09.886546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573f16e-cd07-4219-a14b-e927a7ec267b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:09.889367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573f16e-cd07-4219-a14b-e927a7ec267b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:09.904402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1177/2359] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:09 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:09.908048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08119e8-ffd4-4879-83cb-be7e514f2204 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:09.928399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08119e8-ffd4-4879-83cb-be7e514f2204 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:09.935597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c443323-578a-44cb-acf8-a783a3ec28f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:09.936781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443323-578a-44cb-acf8-a783a3ec28f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:09.937291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443323-578a-44cb-acf8-a783a3ec28f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:09.952295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443323-578a-44cb-acf8-a783a3ec28f9 admin admin] PATH_INFO: `/v3/projects/83f2d9789e9145769aa24d0166575e52/users/887eaae9d3e54725bff2b7ccfb041b53/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:09.955103 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c443323-578a-44cb-acf8-a783a3ec28f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f2d9789e9145769aa24d0166575e52, user_id=887eaae9d3e54725bff2b7ccfb041b53, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:09.961027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c443323-578a-44cb-acf8-a783a3ec28f9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:09.974675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1183/2360] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:09 2021] PUT /identity/v3/projects/83f2d9789e9145769aa24d0166575e52/users/887eaae9d3e54725bff2b7ccfb041b53/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:09.985904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782d7c3-89ee-487f-8dea-9de7823d3554 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:09.986212 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782d7c3-89ee-487f-8dea-9de7823d3554 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:09.986528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782d7c3-89ee-487f-8dea-9de7823d3554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:10.027513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e782d7c3-89ee-487f-8dea-9de7823d3554 None None] MFA Rules not processed for user `887eaae9d3e54725bff2b7ccfb041b53`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:10.028901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e782d7c3-89ee-487f-8dea-9de7823d3554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:10.184289 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1178/2361] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:09 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:10.195279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c443323-578a-44cb-acf8-a783a3ec28f9 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:10.197174 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1c443323-578a-44cb-acf8-a783a3ec28f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:10.292032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c443323-578a-44cb-acf8-a783a3ec28f9 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:10.296446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d831e12-730c-4a95-ac19-024b316dca37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:10.297354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d831e12-730c-4a95-ac19-024b316dca37 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:10.297698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d831e12-730c-4a95-ac19-024b316dca37 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:10.298048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d831e12-730c-4a95-ac19-024b316dca37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:10.365738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d831e12-730c-4a95-ac19-024b316dca37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:10.365738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d831e12-730c-4a95-ac19-024b316dca37 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:10.376320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1184/2362] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:10 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:12.989074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782d7c3-89ee-487f-8dea-9de7823d3554 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:12.991743 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e782d7c3-89ee-487f-8dea-9de7823d3554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:13.009818 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782d7c3-89ee-487f-8dea-9de7823d3554 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:13.017442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9f8a2-ede2-415f-89e0-f1380f3586ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:13.018109 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9f8a2-ede2-415f-89e0-f1380f3586ac service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.019235 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9f8a2-ede2-415f-89e0-f1380f3586ac service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.019514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9f8a2-ede2-415f-89e0-f1380f3586ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.095993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9f8a2-ede2-415f-89e0-f1380f3586ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:13.097594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9f8a2-ede2-415f-89e0-f1380f3586ac service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:13.132313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1179/2363] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:12 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:13.413332 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d831e12-730c-4a95-ac19-024b316dca37 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:13.414768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3d831e12-730c-4a95-ac19-024b316dca37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:13.543902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d831e12-730c-4a95-ac19-024b316dca37 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:13.550843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364e74f-cdc1-4846-8ebf-9e2e4eea9524 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:13.552078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e74f-cdc1-4846-8ebf-9e2e4eea9524 service placement] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.552633 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e74f-cdc1-4846-8ebf-9e2e4eea9524 service placement] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.553135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e74f-cdc1-4846-8ebf-9e2e4eea9524 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.558184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d364e74f-cdc1-4846-8ebf-9e2e4eea9524 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:13.584888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364e74f-cdc1-4846-8ebf-9e2e4eea9524 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:13.591726 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364e74f-cdc1-4846-8ebf-9e2e4eea9524 service placement] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:13.621891 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1185/2364] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:13 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:15.149067 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9f8a2-ede2-415f-89e0-f1380f3586ac service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:15.175638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9f8a2-ede2-415f-89e0-f1380f3586ac service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:15.187011 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a980fa9-0f4a-49a3-bb7c-fa2d015c2212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:15.188062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a980fa9-0f4a-49a3-bb7c-fa2d015c2212 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:15.188847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a980fa9-0f4a-49a3-bb7c-fa2d015c2212 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:15.189450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a980fa9-0f4a-49a3-bb7c-fa2d015c2212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:15.214903 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a980fa9-0f4a-49a3-bb7c-fa2d015c2212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:15.216396 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a980fa9-0f4a-49a3-bb7c-fa2d015c2212 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:15.236434 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1180/2365] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:15 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:16.813941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33faf93-ecaa-4554-bca0-c099734769cc None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:16.814792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33faf93-ecaa-4554-bca0-c099734769cc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:16.815083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33faf93-ecaa-4554-bca0-c099734769cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:16.845011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c33faf93-ecaa-4554-bca0-c099734769cc None None] MFA Rules not processed for user `2bf313c2f1894c7b97d50c9afa8666b3`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:16.846256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c33faf93-ecaa-4554-bca0-c099734769cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:16.931923 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1186/2366] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:16 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:16.943327 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a980fa9-0f4a-49a3-bb7c-fa2d015c2212 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.009438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a980fa9-0f4a-49a3-bb7c-fa2d015c2212 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.014800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe890c9-af1a-4e78-83ce-12dbab59ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.015352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe890c9-af1a-4e78-83ce-12dbab59ec6e admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.015635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe890c9-af1a-4e78-83ce-12dbab59ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.015913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe890c9-af1a-4e78-83ce-12dbab59ec6e admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.016871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe890c9-af1a-4e78-83ce-12dbab59ec6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.019169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe890c9-af1a-4e78-83ce-12dbab59ec6e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.084069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1181/2367] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:16 2021] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:17.088282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33faf93-ecaa-4554-bca0-c099734769cc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.099252 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33faf93-ecaa-4554-bca0-c099734769cc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.162159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d6ea0-c260-4ac8-b7e9-02f4842c2bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.162842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d6ea0-c260-4ac8-b7e9-02f4842c2bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.163302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d6ea0-c260-4ac8-b7e9-02f4842c2bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.163842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d6ea0-c260-4ac8-b7e9-02f4842c2bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.164861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d6ea0-c260-4ac8-b7e9-02f4842c2bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.167420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d6ea0-c260-4ac8-b7e9-02f4842c2bc8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.244234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1187/2368] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:47:17 2021] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:17.248467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe890c9-af1a-4e78-83ce-12dbab59ec6e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.259283 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe890c9-af1a-4e78-83ce-12dbab59ec6e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.264614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22870400-e9c1-43f2-a3e5-20f6ed50ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.265390 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22870400-e9c1-43f2-a3e5-20f6ed50ec62 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.265749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22870400-e9c1-43f2-a3e5-20f6ed50ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.266089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22870400-e9c1-43f2-a3e5-20f6ed50ec62 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.267013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22870400-e9c1-43f2-a3e5-20f6ed50ec62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.268722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22870400-e9c1-43f2-a3e5-20f6ed50ec62 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.280372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1182/2369] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:17 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:17.284726 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d6ea0-c260-4ac8-b7e9-02f4842c2bc8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.305559 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d6ea0-c260-4ac8-b7e9-02f4842c2bc8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.310563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4145a-8ceb-4724-bb96-7e0a4d4cc94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.311450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4145a-8ceb-4724-bb96-7e0a4d4cc94c admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.311737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4145a-8ceb-4724-bb96-7e0a4d4cc94c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.312017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4145a-8ceb-4724-bb96-7e0a4d4cc94c admin admin] PATH_INFO: `/v3/projects/d6f2c8ffb4b14ba68accea005580e1f0/users/e602e99570364be3a933fca9ce24bcba/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.327824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4145a-8ceb-4724-bb96-7e0a4d4cc94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f2c8ffb4b14ba68accea005580e1f0, user_id=e602e99570364be3a933fca9ce24bcba, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.330837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4145a-8ceb-4724-bb96-7e0a4d4cc94c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.427803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1188/2370] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:17 2021] PUT /identity/v3/projects/d6f2c8ffb4b14ba68accea005580e1f0/users/e602e99570364be3a933fca9ce24bcba/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:17.431526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22870400-e9c1-43f2-a3e5-20f6ed50ec62 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.443596 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22870400-e9c1-43f2-a3e5-20f6ed50ec62 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.513758 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe478e1-2501-483e-8022-e5b5730d7618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.514765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe478e1-2501-483e-8022-e5b5730d7618 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.515241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe478e1-2501-483e-8022-e5b5730d7618 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.515532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe478e1-2501-483e-8022-e5b5730d7618 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.516263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe478e1-2501-483e-8022-e5b5730d7618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.518062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe478e1-2501-483e-8022-e5b5730d7618 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.529318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1183/2371] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:17 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:17.533710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4145a-8ceb-4724-bb96-7e0a4d4cc94c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.545338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4145a-8ceb-4724-bb96-7e0a4d4cc94c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.551245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9125592-0b25-43c7-9327-8920d9b36918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.552257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9125592-0b25-43c7-9327-8920d9b36918 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.552906 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9125592-0b25-43c7-9327-8920d9b36918 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.553198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9125592-0b25-43c7-9327-8920d9b36918 admin admin] PATH_INFO: `/v3/projects/d6f2c8ffb4b14ba68accea005580e1f0/users/e602e99570364be3a933fca9ce24bcba/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.556998 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9125592-0b25-43c7-9327-8920d9b36918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f2c8ffb4b14ba68accea005580e1f0, user_id=e602e99570364be3a933fca9ce24bcba, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.560552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9125592-0b25-43c7-9327-8920d9b36918 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.576257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1189/2372] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:17 2021] PUT /identity/v3/projects/d6f2c8ffb4b14ba68accea005580e1f0/users/e602e99570364be3a933fca9ce24bcba/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:20.586034 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe478e1-2501-483e-8022-e5b5730d7618 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:20.607913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe478e1-2501-483e-8022-e5b5730d7618 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:20.747805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:20.749150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:20.754201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:20.754521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] PATH_INFO: `/v3/users/c8fb38afffe4417ab9f3617228c4bde6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:20.772813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8fb38afffe4417ab9f3617228c4bde6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:20.772813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:20.984313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8fb38afffe4417ab9f3617228c4bde6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:21.001335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8fb38afffe4417ab9f3617228c4bde6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:21.002345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8fb38afffe4417ab9f3617228c4bde6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:21.011767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8fb38afffe4417ab9f3617228c4bde6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:21.081217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8fb38afffe4417ab9f3617228c4bde6'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:21.089847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1184/2373] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:47:20 2021] DELETE /identity/v3/users/c8fb38afffe4417ab9f3617228c4bde6 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:21.094468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cac20-8f05-4ab6-8802-f3334e4553d3 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:21.095554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cac20-8f05-4ab6-8802-f3334e4553d3 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:21.096058 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cac20-8f05-4ab6-8802-f3334e4553d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:21.119522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-de1cac20-8f05-4ab6-8802-f3334e4553d3 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:21.121135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-de1cac20-8f05-4ab6-8802-f3334e4553d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:21.201473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1190/2374] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:21.210292 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:21.211786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:21.291003 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68468b-e583-4085-bbf4-285d2adba9dc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:21.300543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92956-e216-4b78-912d-e742d30aa8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:21.301674 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92956-e216-4b78-912d-e742d30aa8fe service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:21.301967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92956-e216-4b78-912d-e742d30aa8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:21.302566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92956-e216-4b78-912d-e742d30aa8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:21.318590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f92956-e216-4b78-912d-e742d30aa8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:21.320059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f92956-e216-4b78-912d-e742d30aa8fe service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:21.332313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1185/2375] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:21.940380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cac20-8f05-4ab6-8802-f3334e4553d3 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:21.941854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-de1cac20-8f05-4ab6-8802-f3334e4553d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:21.962575 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cac20-8f05-4ab6-8802-f3334e4553d3 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:21.969395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:21.972052 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:21.972577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:21.974914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] PATH_INFO: `/v3/projects/f16a076145004b32822d45fcd86ea51e` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:21.974914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16a076145004b32822d45fcd86ea51e)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:21.977432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:22.088677 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16a076145004b32822d45fcd86ea51e', 'request_id': 'req-bb22cb9c-e3ed-4179-8241-22fe992435ab'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:22.162629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16a076145004b32822d45fcd86ea51e', 'request_id': 'req-bb22cb9c-e3ed-4179-8241-22fe992435ab'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:22.173187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16a076145004b32822d45fcd86ea51e', 'request_id': 'req-bb22cb9c-e3ed-4179-8241-22fe992435ab'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:22.192845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] The token cache is being invalidate because project f16a076145004b32822d45fcd86ea51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:22.194086 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:22.195846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:22.203117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92956-e216-4b78-912d-e742d30aa8fe service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:22.203979 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1191/2376] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:47:21 2021] DELETE /identity/v3/projects/f16a076145004b32822d45fcd86ea51e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:22.219298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92956-e216-4b78-912d-e742d30aa8fe service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:22.318487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:22.319700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:22.319982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:22.320258 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] PATH_INFO: `/v3/users/0018814ec9604fa1ab2112d8b005e42c` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:22.321508 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0018814ec9604fa1ab2112d8b005e42c)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:22.323501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:22.635916 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0018814ec9604fa1ab2112d8b005e42c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:22.651795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0018814ec9604fa1ab2112d8b005e42c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:22.652813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0018814ec9604fa1ab2112d8b005e42c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:22.659947 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0018814ec9604fa1ab2112d8b005e42c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:22.732460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0018814ec9604fa1ab2112d8b005e42c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:22.740480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1186/2377] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:47:22 2021] DELETE /identity/v3/users/0018814ec9604fa1ab2112d8b005e42c => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:23.500555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:23.502039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:23.524937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22cb9c-e3ed-4179-8241-22fe992435ab admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:23.620972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:23.621855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:23.622140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:23.622421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] PATH_INFO: `/v3/projects/64c10b8abbf9465aa12809d4a1c015e3` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:23.633391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c10b8abbf9465aa12809d4a1c015e3)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:23.635727 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:23.794959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c10b8abbf9465aa12809d4a1c015e3', 'request_id': 'req-a95d0925-b110-410e-800c-d214e77d3fa4'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:23.903947 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c10b8abbf9465aa12809d4a1c015e3', 'request_id': 'req-a95d0925-b110-410e-800c-d214e77d3fa4'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:23.911264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c10b8abbf9465aa12809d4a1c015e3', 'request_id': 'req-a95d0925-b110-410e-800c-d214e77d3fa4'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:23.927692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] The token cache is being invalidate because project 64c10b8abbf9465aa12809d4a1c015e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:23.930495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:23.930495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:23.930997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1192/2378] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:47:23 2021] DELETE /identity/v3/projects/64c10b8abbf9465aa12809d4a1c015e3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:23.935708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:23.937302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:23.957171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4c261-8eb5-4556-a5d7-9f7bd4996414 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:24.030373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:24.031304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:24.031769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:24.032217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] PATH_INFO: `/v3/users/887eaae9d3e54725bff2b7ccfb041b53` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:24.033809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=887eaae9d3e54725bff2b7ccfb041b53)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:24.036498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:24.315407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887eaae9d3e54725bff2b7ccfb041b53'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:24.338825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887eaae9d3e54725bff2b7ccfb041b53'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:24.339871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887eaae9d3e54725bff2b7ccfb041b53'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:24.361594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887eaae9d3e54725bff2b7ccfb041b53'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:24.475287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-d2ee997b-58a2-4025-a843-f1c95224d0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887eaae9d3e54725bff2b7ccfb041b53'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:24.483612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1187/2379] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:47:23 2021] DELETE /identity/v3/users/887eaae9d3e54725bff2b7ccfb041b53 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:25.475184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:25.476819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:25.496149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0925-b110-410e-800c-d214e77d3fa4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:25.581490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:25.582401 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:25.582740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:25.583017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] PATH_INFO: `/v3/projects/83f2d9789e9145769aa24d0166575e52` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:25.584276 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f2d9789e9145769aa24d0166575e52)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:25.586292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:25.725779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f2d9789e9145769aa24d0166575e52', 'request_id': 'req-830efa11-e6e9-4945-b083-f38c26ca1f8a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:25.858003 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f2d9789e9145769aa24d0166575e52', 'request_id': 'req-830efa11-e6e9-4945-b083-f38c26ca1f8a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:25.864728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f2d9789e9145769aa24d0166575e52', 'request_id': 'req-830efa11-e6e9-4945-b083-f38c26ca1f8a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:25.877188 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] The token cache is being invalidate because project 83f2d9789e9145769aa24d0166575e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:25.877574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:25.878282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-830efa11-e6e9-4945-b083-f38c26ca1f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:25.884251 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1193/2380] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:47:25 2021] DELETE /identity/v3/projects/83f2d9789e9145769aa24d0166575e52 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:25.887053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00314-a6af-4f84-84eb-d3bf36cfdb2a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:25.887591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00314-a6af-4f84-84eb-d3bf36cfdb2a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:25.887591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00314-a6af-4f84-84eb-d3bf36cfdb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:25.907093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ecb00314-a6af-4f84-84eb-d3bf36cfdb2a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:25.908868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ecb00314-a6af-4f84-84eb-d3bf36cfdb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:25.971934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1188/2381] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:25.981958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5038c5d-6837-4c76-884e-0712fbe4c54d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:25.982250 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5038c5d-6837-4c76-884e-0712fbe4c54d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:25.982534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5038c5d-6837-4c76-884e-0712fbe4c54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.005145 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b5038c5d-6837-4c76-884e-0712fbe4c54d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:26.006707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b5038c5d-6837-4c76-884e-0712fbe4c54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:26.007656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab4fc6-ba5b-4438-9ccf-c5c520492736 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:26.007956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab4fc6-ba5b-4438-9ccf-c5c520492736 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:26.008292 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab4fc6-ba5b-4438-9ccf-c5c520492736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.019024 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1194/2382] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:26.020232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5038c5d-6837-4c76-884e-0712fbe4c54d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:26.029683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5038c5d-6837-4c76-884e-0712fbe4c54d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:26.034830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3890-fd56-414f-bad7-f2d802d274ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:26.035582 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3890-fd56-414f-bad7-f2d802d274ef admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:26.035871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3890-fd56-414f-bad7-f2d802d274ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:26.036234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3890-fd56-414f-bad7-f2d802d274ef admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.036924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec3890-fd56-414f-bad7-f2d802d274ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:26.037234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec3890-fd56-414f-bad7-f2d802d274ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:26.039444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec3890-fd56-414f-bad7-f2d802d274ef admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:26.040291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-59ab4fc6-ba5b-4438-9ccf-c5c520492736 None None] MFA Rules not processed for user `e602e99570364be3a933fca9ce24bcba`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:26.042444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-59ab4fc6-ba5b-4438-9ccf-c5c520492736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:26.053331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1195/2383] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:47:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:26.061054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3890-fd56-414f-bad7-f2d802d274ef admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:26.072134 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3890-fd56-414f-bad7-f2d802d274ef admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:26.078973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e00741-cd55-4602-abed-a1c69d209f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:26.079735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e00741-cd55-4602-abed-a1c69d209f78 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:26.080091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e00741-cd55-4602-abed-a1c69d209f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:26.080479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e00741-cd55-4602-abed-a1c69d209f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.081540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e00741-cd55-4602-abed-a1c69d209f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:26.083780 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e00741-cd55-4602-abed-a1c69d209f78 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:26.142071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1189/2384] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:26 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:26.163657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab4fc6-ba5b-4438-9ccf-c5c520492736 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:26.167084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-59ab4fc6-ba5b-4438-9ccf-c5c520492736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:26.218344 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1196/2385] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:26 2021] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:26.219883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e00741-cd55-4602-abed-a1c69d209f78 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:26.292215 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab4fc6-ba5b-4438-9ccf-c5c520492736 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:26.357338 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e00741-cd55-4602-abed-a1c69d209f78 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:26.373629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e3eb3-c0dd-465d-81a2-6b0c104a1adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:26.374324 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3eb3-c0dd-465d-81a2-6b0c104a1adf admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:26.374606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3eb3-c0dd-465d-81a2-6b0c104a1adf admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:26.374885 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3eb3-c0dd-465d-81a2-6b0c104a1adf admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.376300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e3eb3-c0dd-465d-81a2-6b0c104a1adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:26.378718 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e3eb3-c0dd-465d-81a2-6b0c104a1adf admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:26.387251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea1c07-9df4-46de-9130-3219ab69e02f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f041d8d6b5949c48920b729511f3783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:26.388907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea1c07-9df4-46de-9130-3219ab69e02f service glance] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:26.388907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea1c07-9df4-46de-9130-3219ab69e02f service glance] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:26.388907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea1c07-9df4-46de-9130-3219ab69e02f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.390619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b6ea1c07-9df4-46de-9130-3219ab69e02f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:26.474885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea1c07-9df4-46de-9130-3219ab69e02f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:26.476422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea1c07-9df4-46de-9130-3219ab69e02f service glance] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:26.487391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1190/2386] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:26 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:26.495985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1197/2387] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:47:26 2021] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:26.498343 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea1c07-9df4-46de-9130-3219ab69e02f service glance] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:26.520579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea1c07-9df4-46de-9130-3219ab69e02f service glance] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:26.526605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bdad-89fb-403a-ba67-de72c1a9701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:26.527296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bdad-89fb-403a-ba67-de72c1a9701b admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:26.527582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bdad-89fb-403a-ba67-de72c1a9701b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:26.527956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bdad-89fb-403a-ba67-de72c1a9701b admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.528727 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178bdad-89fb-403a-ba67-de72c1a9701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:26.530726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178bdad-89fb-403a-ba67-de72c1a9701b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:26.544312 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1191/2388] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:26 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:26.548301 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e3eb3-c0dd-465d-81a2-6b0c104a1adf admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:26.563514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e3eb3-c0dd-465d-81a2-6b0c104a1adf admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:26.599601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d1d97-ae47-46d4-be10-5843f1269d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:26.600626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d1d97-ae47-46d4-be10-5843f1269d6b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:26.601575 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d1d97-ae47-46d4-be10-5843f1269d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:26.602504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d1d97-ae47-46d4-be10-5843f1269d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.606112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d1d97-ae47-46d4-be10-5843f1269d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:26.608132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d1d97-ae47-46d4-be10-5843f1269d6b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:26.627008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1198/2389] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:26 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:26.627676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bdad-89fb-403a-ba67-de72c1a9701b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:26.642965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bdad-89fb-403a-ba67-de72c1a9701b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:26.653113 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bab90-8a9c-4328-890f-ed22ccf71cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:26.655223 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bab90-8a9c-4328-890f-ed22ccf71cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:26.655223 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bab90-8a9c-4328-890f-ed22ccf71cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:26.655435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bab90-8a9c-4328-890f-ed22ccf71cd9 admin admin] PATH_INFO: `/v3/projects/ff2c23ed82b74574953416ade731ee94/users/0ee3e17bff0f42848cbc261d1d93ae28/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.696336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bab90-8a9c-4328-890f-ed22ccf71cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2c23ed82b74574953416ade731ee94, user_id=0ee3e17bff0f42848cbc261d1d93ae28, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:26.705084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bab90-8a9c-4328-890f-ed22ccf71cd9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:26.819722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1192/2390] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:26 2021] PUT /identity/v3/projects/ff2c23ed82b74574953416ade731ee94/users/0ee3e17bff0f42848cbc261d1d93ae28/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:26.830525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72bb47-d4ad-4dba-adf0-e936a4c3a251 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:26.834932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72bb47-d4ad-4dba-adf0-e936a4c3a251 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:26.835249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72bb47-d4ad-4dba-adf0-e936a4c3a251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.905005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d83bc-c187-4b7a-bdff-1814f0926103 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:26.909607 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d83bc-c187-4b7a-bdff-1814f0926103 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:26.910078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d83bc-c187-4b7a-bdff-1814f0926103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:26.910764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-8e72bb47-d4ad-4dba-adf0-e936a4c3a251 None None] MFA Rules not processed for user `0ee3e17bff0f42848cbc261d1d93ae28`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:26.914026 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8e72bb47-d4ad-4dba-adf0-e936a4c3a251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:27.049875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4f7d83bc-c187-4b7a-bdff-1814f0926103 None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:27.051401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4f7d83bc-c187-4b7a-bdff-1814f0926103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:27.082175 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1199/2391] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:26 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:27.096540 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72bb47-d4ad-4dba-adf0-e936a4c3a251 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:27.170977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1193/2392] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:47:26 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:27.172625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d83bc-c187-4b7a-bdff-1814f0926103 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:27.174442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4f7d83bc-c187-4b7a-bdff-1814f0926103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:27.235446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72bb47-d4ad-4dba-adf0-e936a4c3a251 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:27.241871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56ebb4-7746-4b9c-b96a-76e6ced56745 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f041d8d6b5949c48920b729511f3783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:27.241871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ebb4-7746-4b9c-b96a-76e6ced56745 service glance] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:27.241871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ebb4-7746-4b9c-b96a-76e6ced56745 service glance] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:27.241871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ebb4-7746-4b9c-b96a-76e6ced56745 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:27.251017 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56ebb4-7746-4b9c-b96a-76e6ced56745 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:27.252438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56ebb4-7746-4b9c-b96a-76e6ced56745 service glance] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:27.262904 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1200/2393] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:27 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:27.316081 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d83bc-c187-4b7a-bdff-1814f0926103 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:27.322827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe589ce-589c-44e8-a4b4-9cd1671c92e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:27.323574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe589ce-589c-44e8-a4b4-9cd1671c92e5 service swift] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:27.324030 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe589ce-589c-44e8-a4b4-9cd1671c92e5 service swift] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:27.324321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe589ce-589c-44e8-a4b4-9cd1671c92e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:27.334980 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe589ce-589c-44e8-a4b4-9cd1671c92e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:27.336630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe589ce-589c-44e8-a4b4-9cd1671c92e5 service swift] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:27.349784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1194/2394] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:47:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:47:28.472372 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5ca90-775a-4bdb-b218-5efaf7f44bbc None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:28.472372 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5ca90-775a-4bdb-b218-5efaf7f44bbc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:28.472372 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5ca90-775a-4bdb-b218-5efaf7f44bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:28.501328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7bb5ca90-775a-4bdb-b218-5efaf7f44bbc None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:28.502820 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7bb5ca90-775a-4bdb-b218-5efaf7f44bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:28.517302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1201/2395] 10.222.0.25 () {58 vars in 968 bytes} [Fri Aug 27 04:47:28 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:28.525148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe589ce-589c-44e8-a4b4-9cd1671c92e5 service swift] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:28.555555 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe589ce-589c-44e8-a4b4-9cd1671c92e5 service swift] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:28.572501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a21e60-8739-4b0a-8fd1-55e14713e2dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:28.573438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a21e60-8739-4b0a-8fd1-55e14713e2dc service swift] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:28.573933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a21e60-8739-4b0a-8fd1-55e14713e2dc service swift] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:28.574418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a21e60-8739-4b0a-8fd1-55e14713e2dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:28.604637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a21e60-8739-4b0a-8fd1-55e14713e2dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:28.608160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a21e60-8739-4b0a-8fd1-55e14713e2dc service swift] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:28.629202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1195/2396] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:47:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:47:31.331131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5ca90-775a-4bdb-b218-5efaf7f44bbc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:31.332710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7bb5ca90-775a-4bdb-b218-5efaf7f44bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:31.403057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5ca90-775a-4bdb-b218-5efaf7f44bbc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:31.407955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18940f1-b04f-4519-85d0-1aa22924d81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:31.408723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18940f1-b04f-4519-85d0-1aa22924d81d service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:31.409011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18940f1-b04f-4519-85d0-1aa22924d81d service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:31.409290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18940f1-b04f-4519-85d0-1aa22924d81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:31.412597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a18940f1-b04f-4519-85d0-1aa22924d81d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:31.504524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18940f1-b04f-4519-85d0-1aa22924d81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:31.520727 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18940f1-b04f-4519-85d0-1aa22924d81d service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:31.535020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1202/2397] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:31 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:36.176882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a21e60-8739-4b0a-8fd1-55e14713e2dc service swift] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:36.178576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-77a21e60-8739-4b0a-8fd1-55e14713e2dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:36.364577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a21e60-8739-4b0a-8fd1-55e14713e2dc service swift] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:36.379751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:36.380680 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:36.380967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:36.381242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] PATH_INFO: `/v3/users/b5b99e0829e84f2bb0a58e835a1cdc47` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:36.384439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b99e0829e84f2bb0a58e835a1cdc47)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:36.386694 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:36.593477 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b99e0829e84f2bb0a58e835a1cdc47'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:36.624808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b99e0829e84f2bb0a58e835a1cdc47'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:36.625773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b99e0829e84f2bb0a58e835a1cdc47'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:36.637450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b99e0829e84f2bb0a58e835a1cdc47'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:36.709129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-00aa01c5-67cd-4e7f-b346-24efad07ea7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b99e0829e84f2bb0a58e835a1cdc47'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:36.719487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1196/2398] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:47:36 2021] DELETE /identity/v3/users/b5b99e0829e84f2bb0a58e835a1cdc47 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:37.031423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18940f1-b04f-4519-85d0-1aa22924d81d service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:37.046392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18940f1-b04f-4519-85d0-1aa22924d81d service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:37.126044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:37.126948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.127233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.127502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] PATH_INFO: `/v3/projects/47cca0df6e9e4252b3273dbfa06aa6bf` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.128811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cca0df6e9e4252b3273dbfa06aa6bf)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:37.130930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:37.304760 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cca0df6e9e4252b3273dbfa06aa6bf', 'request_id': 'req-cd0314a8-e6d0-415b-93c2-f8c89634e43a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:37.383716 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cca0df6e9e4252b3273dbfa06aa6bf', 'request_id': 'req-cd0314a8-e6d0-415b-93c2-f8c89634e43a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:37.394333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cca0df6e9e4252b3273dbfa06aa6bf', 'request_id': 'req-cd0314a8-e6d0-415b-93c2-f8c89634e43a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:37.409264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] The token cache is being invalidate because project 47cca0df6e9e4252b3273dbfa06aa6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:37.409732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:37.410692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-cd0314a8-e6d0-415b-93c2-f8c89634e43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:37.422753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f21c1-de79-462c-b0bb-f2cb8215f3bf None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.423719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f21c1-de79-462c-b0bb-f2cb8215f3bf None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.424239 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f21c1-de79-462c-b0bb-f2cb8215f3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.425952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1203/2399] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:47:37 2021] DELETE /identity/v3/projects/47cca0df6e9e4252b3273dbfa06aa6bf => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:37.453170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-756f21c1-de79-462c-b0bb-f2cb8215f3bf None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:37.455377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-756f21c1-de79-462c-b0bb-f2cb8215f3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:37.579936 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1197/2400] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:37.589982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d0da-1ce8-4cfc-974b-b3fa9d19de55 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.590487 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d0da-1ce8-4cfc-974b-b3fa9d19de55 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.590909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d0da-1ce8-4cfc-974b-b3fa9d19de55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.612399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-6256d0da-1ce8-4cfc-974b-b3fa9d19de55 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:37.613836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6256d0da-1ce8-4cfc-974b-b3fa9d19de55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:37.622719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1204/2401] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:37.627240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f21c1-de79-462c-b0bb-f2cb8215f3bf None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:37.637851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f21c1-de79-462c-b0bb-f2cb8215f3bf None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:37.643124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52fc29-723a-4a9b-a0d9-539511c4987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:37.643805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52fc29-723a-4a9b-a0d9-539511c4987e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.644246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52fc29-723a-4a9b-a0d9-539511c4987e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.644573 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52fc29-723a-4a9b-a0d9-539511c4987e admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.645308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52fc29-723a-4a9b-a0d9-539511c4987e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:37.645614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52fc29-723a-4a9b-a0d9-539511c4987e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:37.647582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52fc29-723a-4a9b-a0d9-539511c4987e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:37.664682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1198/2402] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:47:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:37.666766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256d0da-1ce8-4cfc-974b-b3fa9d19de55 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:37.683587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256d0da-1ce8-4cfc-974b-b3fa9d19de55 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:37.695886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5cdf5-6c74-48a7-8aff-8b84f0849940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:37.695886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5cdf5-6c74-48a7-8aff-8b84f0849940 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.695886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5cdf5-6c74-48a7-8aff-8b84f0849940 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.695886 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5cdf5-6c74-48a7-8aff-8b84f0849940 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.696425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5cdf5-6c74-48a7-8aff-8b84f0849940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:37.696425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5cdf5-6c74-48a7-8aff-8b84f0849940 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:37.796597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1205/2403] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:37 2021] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:37.801333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52fc29-723a-4a9b-a0d9-539511c4987e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:37.831854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52fc29-723a-4a9b-a0d9-539511c4987e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:37.917433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e64bb3-d44b-4344-ae30-a43c43b788e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:37.918344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e64bb3-d44b-4344-ae30-a43c43b788e2 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.918753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e64bb3-d44b-4344-ae30-a43c43b788e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.919100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e64bb3-d44b-4344-ae30-a43c43b788e2 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.919873 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e64bb3-d44b-4344-ae30-a43c43b788e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:37.921954 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e64bb3-d44b-4344-ae30-a43c43b788e2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:38.022636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1199/2404] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:47:37 2021] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:38.023837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5cdf5-6c74-48a7-8aff-8b84f0849940 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:38.039244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5cdf5-6c74-48a7-8aff-8b84f0849940 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:38.048767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e834ec-6226-4956-9f1c-e463e945d56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:38.049901 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e834ec-6226-4956-9f1c-e463e945d56a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:38.050172 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e834ec-6226-4956-9f1c-e463e945d56a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:38.050640 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e834ec-6226-4956-9f1c-e463e945d56a admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:38.052051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e834ec-6226-4956-9f1c-e463e945d56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:38.053655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e834ec-6226-4956-9f1c-e463e945d56a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:38.067277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1206/2405] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:38 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:38.073945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e64bb3-d44b-4344-ae30-a43c43b788e2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:38.097160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e64bb3-d44b-4344-ae30-a43c43b788e2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:38.123467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3da87-2fe9-4bfe-8e67-5aa033cd945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:38.123467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3da87-2fe9-4bfe-8e67-5aa033cd945f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:38.124045 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3da87-2fe9-4bfe-8e67-5aa033cd945f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:38.125885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3da87-2fe9-4bfe-8e67-5aa033cd945f admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:38.127093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3da87-2fe9-4bfe-8e67-5aa033cd945f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:38.128848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3da87-2fe9-4bfe-8e67-5aa033cd945f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:38.157010 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e834ec-6226-4956-9f1c-e463e945d56a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:38.158359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1200/2406] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:38 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:38.170036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e834ec-6226-4956-9f1c-e463e945d56a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:38.180392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e5304-cea7-40e2-b0c0-d855a1a0e8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:38.182241 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5304-cea7-40e2-b0c0-d855a1a0e8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:38.182552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5304-cea7-40e2-b0c0-d855a1a0e8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:38.182950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5304-cea7-40e2-b0c0-d855a1a0e8ae admin admin] PATH_INFO: `/v3/projects/243d0ec308fa426eab1adb6dcbb80214/users/14ca309c0281476aa0add20a7f3e930d/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:38.202675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e5304-cea7-40e2-b0c0-d855a1a0e8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=243d0ec308fa426eab1adb6dcbb80214, user_id=14ca309c0281476aa0add20a7f3e930d, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:38.205731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e5304-cea7-40e2-b0c0-d855a1a0e8ae admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:38.301546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856fd44-51c0-4f79-be8d-92a5028aec75 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:38.301546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856fd44-51c0-4f79-be8d-92a5028aec75 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:38.301546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856fd44-51c0-4f79-be8d-92a5028aec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:38.303976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1207/2407] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:38 2021] PUT /identity/v3/projects/243d0ec308fa426eab1adb6dcbb80214/users/14ca309c0281476aa0add20a7f3e930d/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:38.335840 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-2856fd44-51c0-4f79-be8d-92a5028aec75 None None] MFA Rules not processed for user `14ca309c0281476aa0add20a7f3e930d`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:38.337287 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-2856fd44-51c0-4f79-be8d-92a5028aec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:38.439644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1201/2408] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:38 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:38.451783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e5304-cea7-40e2-b0c0-d855a1a0e8ae admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:38.453857 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b01e5304-cea7-40e2-b0c0-d855a1a0e8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:38.600462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e5304-cea7-40e2-b0c0-d855a1a0e8ae admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:38.610948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ff566-3f71-4c49-aca2-f22226024889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:38.611629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ff566-3f71-4c49-aca2-f22226024889 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:38.614767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ff566-3f71-4c49-aca2-f22226024889 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:38.614767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ff566-3f71-4c49-aca2-f22226024889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:38.625830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ff566-3f71-4c49-aca2-f22226024889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:38.627530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ff566-3f71-4c49-aca2-f22226024889 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:38.638735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1208/2409] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:38 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:40.957864 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8983e9-26f9-444f-9553-3808ed41a7de None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:40.958765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8983e9-26f9-444f-9553-3808ed41a7de None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:40.959059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8983e9-26f9-444f-9553-3808ed41a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:40.980968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ba8983e9-26f9-444f-9553-3808ed41a7de None None] MFA Rules not processed for user `2bf313c2f1894c7b97d50c9afa8666b3`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:40.982265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ba8983e9-26f9-444f-9553-3808ed41a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:41.048315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1202/2410] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:40 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:43.184754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ff566-3f71-4c49-aca2-f22226024889 service nova] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:43.184754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-520ff566-3f71-4c49-aca2-f22226024889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:43.259390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ff566-3f71-4c49-aca2-f22226024889 service nova] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:43.264704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:43.265624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:43.265902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:43.266178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] PATH_INFO: `/v3/users/d21dce70b6444f0a9c129ae8bc6fdb38` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:43.267514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21dce70b6444f0a9c129ae8bc6fdb38)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:43.269508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:43.489159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21dce70b6444f0a9c129ae8bc6fdb38'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:43.489808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21dce70b6444f0a9c129ae8bc6fdb38'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:43.490407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21dce70b6444f0a9c129ae8bc6fdb38'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:43.502166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21dce70b6444f0a9c129ae8bc6fdb38'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:43.565975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a09770e7-fde1-4dd1-9412-4a2e6751bb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21dce70b6444f0a9c129ae8bc6fdb38'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:43.578461 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1209/2411] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:47:43 2021] DELETE /identity/v3/users/d21dce70b6444f0a9c129ae8bc6fdb38 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:43.882976 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8983e9-26f9-444f-9553-3808ed41a7de None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:43.898323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8983e9-26f9-444f-9553-3808ed41a7de None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:43.955243 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:43.956029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:43.956311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:43.956622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] PATH_INFO: `/v3/projects/bab1a23d8ead4f71956c5e90bbe29587` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:43.957796 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab1a23d8ead4f71956c5e90bbe29587)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:43.959678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.086464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab1a23d8ead4f71956c5e90bbe29587', 'request_id': 'req-903e30d3-3827-4020-be6d-ced356823676'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:44.094319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab1a23d8ead4f71956c5e90bbe29587', 'request_id': 'req-903e30d3-3827-4020-be6d-ced356823676'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:44.101125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab1a23d8ead4f71956c5e90bbe29587', 'request_id': 'req-903e30d3-3827-4020-be6d-ced356823676'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:44.177069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] The token cache is being invalidate because project bab1a23d8ead4f71956c5e90bbe29587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:44.177360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:44.178004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-903e30d3-3827-4020-be6d-ced356823676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:44.179569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1203/2412] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:47:43 2021] DELETE /identity/v3/projects/bab1a23d8ead4f71956c5e90bbe29587 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:44.185546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b594-cb51-4271-b38b-d136df311811 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.188788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b594-cb51-4271-b38b-d136df311811 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.188788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b594-cb51-4271-b38b-d136df311811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.204744 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-9560b594-cb51-4271-b38b-d136df311811 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:44.206143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9560b594-cb51-4271-b38b-d136df311811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:44.275308 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1210/2413] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:44.285651 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554253bd-1c57-4664-9d7b-3ecd52ff0c61 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.285651 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554253bd-1c57-4664-9d7b-3ecd52ff0c61 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.285651 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554253bd-1c57-4664-9d7b-3ecd52ff0c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.303090 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-554253bd-1c57-4664-9d7b-3ecd52ff0c61 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:44.304322 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-554253bd-1c57-4664-9d7b-3ecd52ff0c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:44.313217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1204/2414] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:44.317636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560b594-cb51-4271-b38b-d136df311811 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:44.327815 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560b594-cb51-4271-b38b-d136df311811 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:44.332701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c415e4-859e-466f-bfa4-fa279d7f1693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:44.333348 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c415e4-859e-466f-bfa4-fa279d7f1693 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.333634 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c415e4-859e-466f-bfa4-fa279d7f1693 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.333912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c415e4-859e-466f-bfa4-fa279d7f1693 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.334633 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c415e4-859e-466f-bfa4-fa279d7f1693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:44.334943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c415e4-859e-466f-bfa4-fa279d7f1693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:44.336601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c415e4-859e-466f-bfa4-fa279d7f1693 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.348400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1211/2415] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:47:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:44.352998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554253bd-1c57-4664-9d7b-3ecd52ff0c61 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:44.362604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554253bd-1c57-4664-9d7b-3ecd52ff0c61 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:44.367523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b4dde-4323-4750-aba1-bb85afa2cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:44.368188 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4dde-4323-4750-aba1-bb85afa2cbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.369243 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4dde-4323-4750-aba1-bb85afa2cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.369401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4dde-4323-4750-aba1-bb85afa2cbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.370095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b4dde-4323-4750-aba1-bb85afa2cbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:44.372075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b4dde-4323-4750-aba1-bb85afa2cbb2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.499206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1205/2416] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:44 2021] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:44.503511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c415e4-859e-466f-bfa4-fa279d7f1693 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:44.520775 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c415e4-859e-466f-bfa4-fa279d7f1693 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:44.568228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075560f-ddf3-4a2f-a786-a5632258fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:44.568934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075560f-ddf3-4a2f-a786-a5632258fec9 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.569216 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075560f-ddf3-4a2f-a786-a5632258fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.569495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075560f-ddf3-4a2f-a786-a5632258fec9 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.570178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075560f-ddf3-4a2f-a786-a5632258fec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:44.572789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075560f-ddf3-4a2f-a786-a5632258fec9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.670509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1212/2417] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:47:44 2021] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:44.675170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b4dde-4323-4750-aba1-bb85afa2cbb2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:44.688192 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b4dde-4323-4750-aba1-bb85afa2cbb2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:44.693532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51e300-0dcd-4f28-8999-67ce7c7da306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:44.694598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51e300-0dcd-4f28-8999-67ce7c7da306 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.695073 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51e300-0dcd-4f28-8999-67ce7c7da306 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.695488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51e300-0dcd-4f28-8999-67ce7c7da306 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.696677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51e300-0dcd-4f28-8999-67ce7c7da306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:44.699523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51e300-0dcd-4f28-8999-67ce7c7da306 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.712457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1206/2418] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:44 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:44.716744 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075560f-ddf3-4a2f-a786-a5632258fec9 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:44.726808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075560f-ddf3-4a2f-a786-a5632258fec9 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:44.732089 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d1a0f-4431-4a68-b049-7faa3d5df91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:44.732797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d1a0f-4431-4a68-b049-7faa3d5df91c admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.733076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d1a0f-4431-4a68-b049-7faa3d5df91c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.733352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d1a0f-4431-4a68-b049-7faa3d5df91c admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.734082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d1a0f-4431-4a68-b049-7faa3d5df91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:44.735700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d1a0f-4431-4a68-b049-7faa3d5df91c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.747012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1213/2419] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:44.751055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51e300-0dcd-4f28-8999-67ce7c7da306 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:44.762823 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51e300-0dcd-4f28-8999-67ce7c7da306 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:44.767921 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec415ce7-5f74-459c-9390-f4a749305d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:44.768873 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec415ce7-5f74-459c-9390-f4a749305d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.769150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec415ce7-5f74-459c-9390-f4a749305d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.769419 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec415ce7-5f74-459c-9390-f4a749305d51 admin admin] PATH_INFO: `/v3/projects/d64a0028b26d4857b0daf241b29ee95b/users/ffd9f61944414b4f886413ad331d4378/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.788614 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec415ce7-5f74-459c-9390-f4a749305d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64a0028b26d4857b0daf241b29ee95b, user_id=ffd9f61944414b4f886413ad331d4378, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:44.792190 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec415ce7-5f74-459c-9390-f4a749305d51 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.915839 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1207/2420] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:44 2021] PUT /identity/v3/projects/d64a0028b26d4857b0daf241b29ee95b/users/ffd9f61944414b4f886413ad331d4378/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:44.922963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996e30-5cb4-46b5-85e8-317dd7b8805d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.923267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996e30-5cb4-46b5-85e8-317dd7b8805d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.923553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996e30-5cb4-46b5-85e8-317dd7b8805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.942974 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3b996e30-5cb4-46b5-85e8-317dd7b8805d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:44.944199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3b996e30-5cb4-46b5-85e8-317dd7b8805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:45.002394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1214/2421] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:45.012851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec415ce7-5f74-459c-9390-f4a749305d51 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:45.014820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ec415ce7-5f74-459c-9390-f4a749305d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:45.072013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec415ce7-5f74-459c-9390-f4a749305d51 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:45.075694 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88351-9e07-4e45-84bc-abde0e1cb01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:45.076364 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88351-9e07-4e45-84bc-abde0e1cb01b service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:45.076661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88351-9e07-4e45-84bc-abde0e1cb01b service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:45.076940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88351-9e07-4e45-84bc-abde0e1cb01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:45.086369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b88351-9e07-4e45-84bc-abde0e1cb01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:45.088377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b88351-9e07-4e45-84bc-abde0e1cb01b service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:45.098028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1208/2422] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:46.798343 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0f18-a16c-43b2-9566-b65725a8c562 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:46.798856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0f18-a16c-43b2-9566-b65725a8c562 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:46.798938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0f18-a16c-43b2-9566-b65725a8c562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:46.819748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e3db0f18-a16c-43b2-9566-b65725a8c562 None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:46.821921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e3db0f18-a16c-43b2-9566-b65725a8c562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:46.888709 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1215/2423] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:47:46 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:46.916194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88351-9e07-4e45-84bc-abde0e1cb01b service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:46.916194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d2b88351-9e07-4e45-84bc-abde0e1cb01b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:46.985943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88351-9e07-4e45-84bc-abde0e1cb01b service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:46.992014 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd9923-081e-4530-ba5b-6fd371bf99df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:46.992836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd9923-081e-4530-ba5b-6fd371bf99df service swift] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:46.993117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd9923-081e-4530-ba5b-6fd371bf99df service swift] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:46.993436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd9923-081e-4530-ba5b-6fd371bf99df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:47.003381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd9923-081e-4530-ba5b-6fd371bf99df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:47.005036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd9923-081e-4530-ba5b-6fd371bf99df service swift] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:47.016529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1209/2424] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:47:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:47:49.200322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db0f18-a16c-43b2-9566-b65725a8c562 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:49.200322 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e3db0f18-a16c-43b2-9566-b65725a8c562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:49.217657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db0f18-a16c-43b2-9566-b65725a8c562 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:49.223839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:49.225124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:49.225615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:49.226059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] PATH_INFO: `/v3/users/14ca309c0281476aa0add20a7f3e930d` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:49.228539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ca309c0281476aa0add20a7f3e930d)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:49.233775 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:49.448456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ca309c0281476aa0add20a7f3e930d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:49.463601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ca309c0281476aa0add20a7f3e930d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:49.464524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ca309c0281476aa0add20a7f3e930d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:49.482900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ca309c0281476aa0add20a7f3e930d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:49.557485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ca309c0281476aa0add20a7f3e930d'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:49.587014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1216/2425] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:47:49 2021] DELETE /identity/v3/users/14ca309c0281476aa0add20a7f3e930d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:49.598094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f88cb2-2e88-44d8-996a-4a5666fbb55e None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:49.599184 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f88cb2-2e88-44d8-996a-4a5666fbb55e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:49.599487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f88cb2-2e88-44d8-996a-4a5666fbb55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:49.618709 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-02f88cb2-2e88-44d8-996a-4a5666fbb55e None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:49.620510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-02f88cb2-2e88-44d8-996a-4a5666fbb55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:49.699335 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1210/2426] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:49.712263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:49.713758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:49.826670 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff840334-8cdb-41b6-b0f4-3dc61d2f7cb0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:49.837576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5245576-84f4-4b9d-886c-0e75025b47c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:49.838276 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5245576-84f4-4b9d-886c-0e75025b47c3 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:49.838639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5245576-84f4-4b9d-886c-0e75025b47c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:49.838918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5245576-84f4-4b9d-886c-0e75025b47c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:49.849536 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5245576-84f4-4b9d-886c-0e75025b47c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:49.851316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5245576-84f4-4b9d-886c-0e75025b47c3 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:49.874249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1217/2427] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:50.828252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f88cb2-2e88-44d8-996a-4a5666fbb55e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:50.830502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-02f88cb2-2e88-44d8-996a-4a5666fbb55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:50.871075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f88cb2-2e88-44d8-996a-4a5666fbb55e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:50.884319 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:50.886563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:50.887423 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:50.887720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] PATH_INFO: `/v3/projects/243d0ec308fa426eab1adb6dcbb80214` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:50.889297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=243d0ec308fa426eab1adb6dcbb80214)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:50.891472 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:51.086318 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243d0ec308fa426eab1adb6dcbb80214', 'request_id': 'req-378b0650-ca4f-407c-aa8e-d3633b3568d3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:51.096262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243d0ec308fa426eab1adb6dcbb80214', 'request_id': 'req-378b0650-ca4f-407c-aa8e-d3633b3568d3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:51.113288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243d0ec308fa426eab1adb6dcbb80214', 'request_id': 'req-378b0650-ca4f-407c-aa8e-d3633b3568d3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:51.241392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] The token cache is being invalidate because project 243d0ec308fa426eab1adb6dcbb80214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:51.241392 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:51.241890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-378b0650-ca4f-407c-aa8e-d3633b3568d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:51.250120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1211/2428] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:47:50 2021] DELETE /identity/v3/projects/243d0ec308fa426eab1adb6dcbb80214 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:51.250664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149015-a767-4fb4-8795-2fa76521280b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:51.251149 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149015-a767-4fb4-8795-2fa76521280b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:51.251244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149015-a767-4fb4-8795-2fa76521280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:51.293522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0b149015-a767-4fb4-8795-2fa76521280b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:51.295207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0b149015-a767-4fb4-8795-2fa76521280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:51.451807 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1218/2429] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:51.460005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7575d2-60e0-4525-8389-3c5525fd922e None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:51.460300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7575d2-60e0-4525-8389-3c5525fd922e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:51.460644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7575d2-60e0-4525-8389-3c5525fd922e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:51.497458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4e7575d2-60e0-4525-8389-3c5525fd922e None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:51.502510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4e7575d2-60e0-4525-8389-3c5525fd922e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:51.512452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1212/2430] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:51.514347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b149015-a767-4fb4-8795-2fa76521280b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:51.545562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b149015-a767-4fb4-8795-2fa76521280b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:51.581218 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369d8d1-6e56-4de6-83de-7cfe9a603fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:51.582711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369d8d1-6e56-4de6-83de-7cfe9a603fee admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:51.582711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369d8d1-6e56-4de6-83de-7cfe9a603fee admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:51.582711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369d8d1-6e56-4de6-83de-7cfe9a603fee admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:51.583179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369d8d1-6e56-4de6-83de-7cfe9a603fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:51.583520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369d8d1-6e56-4de6-83de-7cfe9a603fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:51.588067 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369d8d1-6e56-4de6-83de-7cfe9a603fee admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:51.611982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1219/2431] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:47:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:51.618891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7575d2-60e0-4525-8389-3c5525fd922e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:51.651848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7575d2-60e0-4525-8389-3c5525fd922e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:51.682345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ff79c-40b5-47c4-8f9b-8f197613223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:51.684619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ff79c-40b5-47c4-8f9b-8f197613223e admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:51.685682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ff79c-40b5-47c4-8f9b-8f197613223e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:51.688683 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ff79c-40b5-47c4-8f9b-8f197613223e admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:51.690151 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ff79c-40b5-47c4-8f9b-8f197613223e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:51.716767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ff79c-40b5-47c4-8f9b-8f197613223e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:51.879767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1213/2432] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:51 2021] POST /identity/v3/projects => generated 381 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:51.885549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369d8d1-6e56-4de6-83de-7cfe9a603fee admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:51.933412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369d8d1-6e56-4de6-83de-7cfe9a603fee admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:52.101866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d11fdd-b249-49d6-93c9-9c3adb16ab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:52.104674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d11fdd-b249-49d6-93c9-9c3adb16ab95 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:52.115576 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d11fdd-b249-49d6-93c9-9c3adb16ab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:52.115842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d11fdd-b249-49d6-93c9-9c3adb16ab95 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:52.116985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d11fdd-b249-49d6-93c9-9c3adb16ab95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:52.122156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d11fdd-b249-49d6-93c9-9c3adb16ab95 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:52.267974 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1220/2433] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:47:51 2021] POST /identity/v3/users => generated 291 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:52.272724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ff79c-40b5-47c4-8f9b-8f197613223e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:52.288344 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ff79c-40b5-47c4-8f9b-8f197613223e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:52.324655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b336f-d595-48de-8fdd-b68a3893d6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:52.325489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b336f-d595-48de-8fdd-b68a3893d6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:52.325842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b336f-d595-48de-8fdd-b68a3893d6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:52.326196 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b336f-d595-48de-8fdd-b68a3893d6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:52.327066 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b336f-d595-48de-8fdd-b68a3893d6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:52.328877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b336f-d595-48de-8fdd-b68a3893d6a8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:52.371038 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1214/2434] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:52 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:52.376238 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d11fdd-b249-49d6-93c9-9c3adb16ab95 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:52.388749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d11fdd-b249-49d6-93c9-9c3adb16ab95 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:52.402792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86ea57-e097-4a77-8975-16c24fdf1ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:52.406843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86ea57-e097-4a77-8975-16c24fdf1ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:52.406843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86ea57-e097-4a77-8975-16c24fdf1ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:52.406843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86ea57-e097-4a77-8975-16c24fdf1ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:52.406843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86ea57-e097-4a77-8975-16c24fdf1ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:52.406843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86ea57-e097-4a77-8975-16c24fdf1ee0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:52.438700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1221/2435] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:52 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:52.443216 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b336f-d595-48de-8fdd-b68a3893d6a8 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:52.457056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b336f-d595-48de-8fdd-b68a3893d6a8 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:52.468945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223935-16c8-4a9e-890c-d9e3aa527fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:52.468945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223935-16c8-4a9e-890c-d9e3aa527fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:52.468945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223935-16c8-4a9e-890c-d9e3aa527fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:52.468945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223935-16c8-4a9e-890c-d9e3aa527fc4 admin admin] PATH_INFO: `/v3/projects/fc6ab307f8554e67a3d4865214f5f6d5/users/77235af206c247ba959b7315dee4625f/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:52.503258 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b223935-16c8-4a9e-890c-d9e3aa527fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6ab307f8554e67a3d4865214f5f6d5, user_id=77235af206c247ba959b7315dee4625f, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:52.510016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b223935-16c8-4a9e-890c-d9e3aa527fc4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:52.624936 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1215/2436] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:52 2021] PUT /identity/v3/projects/fc6ab307f8554e67a3d4865214f5f6d5/users/77235af206c247ba959b7315dee4625f/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:52.635780 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58810-0176-4ef2-a1a8-549f737bafd3 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:52.636073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58810-0176-4ef2-a1a8-549f737bafd3 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:52.636587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58810-0176-4ef2-a1a8-549f737bafd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:52.715240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-66a58810-0176-4ef2-a1a8-549f737bafd3 None None] MFA Rules not processed for user `77235af206c247ba959b7315dee4625f`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:52.716473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-66a58810-0176-4ef2-a1a8-549f737bafd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:52.842676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1222/2437] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:52 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:52.847414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223935-16c8-4a9e-890c-d9e3aa527fc4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:53.046147 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223935-16c8-4a9e-890c-d9e3aa527fc4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:53.071811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fa3cc-fe45-4fd1-9672-30c232135a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:53.072618 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fa3cc-fe45-4fd1-9672-30c232135a15 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:53.072843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fa3cc-fe45-4fd1-9672-30c232135a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:53.073120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fa3cc-fe45-4fd1-9672-30c232135a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:53.073847 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fa3cc-fe45-4fd1-9672-30c232135a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:53.076756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fa3cc-fe45-4fd1-9672-30c232135a15 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:53.256071 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1216/2438] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:52 2021] POST /identity/v3/projects => generated 381 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:53.262758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a58810-0176-4ef2-a1a8-549f737bafd3 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:53.318932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a58810-0176-4ef2-a1a8-549f737bafd3 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:53.529458 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e099a-8804-4047-b79d-787500f31758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:53.533081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e099a-8804-4047-b79d-787500f31758 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:53.536107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e099a-8804-4047-b79d-787500f31758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:53.536584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e099a-8804-4047-b79d-787500f31758 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:53.537458 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e099a-8804-4047-b79d-787500f31758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:53.549546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e099a-8804-4047-b79d-787500f31758 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:53.664365 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a572-9c24-4653-a3db-077d178bf0f8 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:53.665832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a572-9c24-4653-a3db-077d178bf0f8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:53.666404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a572-9c24-4653-a3db-077d178bf0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:53.677504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1223/2439] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:47:53 2021] POST /identity/v3/users => generated 297 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:53.681948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e099a-8804-4047-b79d-787500f31758 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:53.702160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-bd15a572-9c24-4653-a3db-077d178bf0f8 None None] MFA Rules not processed for user `ffd9f61944414b4f886413ad331d4378`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:53.703802 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-bd15a572-9c24-4653-a3db-077d178bf0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:53.705498 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e099a-8804-4047-b79d-787500f31758 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:53.723778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0448-2ab3-46d5-aab0-cf9384fca0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:53.724623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0448-2ab3-46d5-aab0-cf9384fca0bd admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:53.724981 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0448-2ab3-46d5-aab0-cf9384fca0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:53.725775 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0448-2ab3-46d5-aab0-cf9384fca0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:53.726169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b0448-2ab3-46d5-aab0-cf9384fca0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:53.729110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b0448-2ab3-46d5-aab0-cf9384fca0bd admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:53.752056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1224/2440] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:53 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:53.756056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0448-2ab3-46d5-aab0-cf9384fca0bd admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:53.768486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0448-2ab3-46d5-aab0-cf9384fca0bd admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:53.779295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc3424-0deb-4b89-939a-1d5d4a2161b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:53.780623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc3424-0deb-4b89-939a-1d5d4a2161b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:53.780895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc3424-0deb-4b89-939a-1d5d4a2161b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:53.781178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc3424-0deb-4b89-939a-1d5d4a2161b3 admin admin] PATH_INFO: `/v3/projects/dc45be86bb394868b8d50f25802564d7/users/c2d8cf703b8842fdba4dc3960998a660/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:53.807842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc3424-0deb-4b89-939a-1d5d4a2161b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc45be86bb394868b8d50f25802564d7, user_id=c2d8cf703b8842fdba4dc3960998a660, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:53.811440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc3424-0deb-4b89-939a-1d5d4a2161b3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:53.850251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1217/2441] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:53 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:53.865009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15a572-9c24-4653-a3db-077d178bf0f8 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:53.867031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-bd15a572-9c24-4653-a3db-077d178bf0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:53.932066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1225/2442] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:53 2021] PUT /identity/v3/projects/dc45be86bb394868b8d50f25802564d7/users/c2d8cf703b8842fdba4dc3960998a660/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:53.940289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc3424-0deb-4b89-939a-1d5d4a2161b3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:54.000015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15a572-9c24-4653-a3db-077d178bf0f8 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:54.024845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc3424-0deb-4b89-939a-1d5d4a2161b3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:54.031867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5a098-6be0-4a65-931f-a53303da4a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:54.032651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5a098-6be0-4a65-931f-a53303da4a58 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:54.032930 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5a098-6be0-4a65-931f-a53303da4a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:54.033295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5a098-6be0-4a65-931f-a53303da4a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:54.033938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5a098-6be0-4a65-931f-a53303da4a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:54.035828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5a098-6be0-4a65-931f-a53303da4a58 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:54.047462 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1226/2443] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:47:53 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:54.051420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5a098-6be0-4a65-931f-a53303da4a58 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:54.063894 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5a098-6be0-4a65-931f-a53303da4a58 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:54.069507 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46d237-4884-48e7-9478-f37fc110c365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:54.071301 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46d237-4884-48e7-9478-f37fc110c365 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:54.071687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46d237-4884-48e7-9478-f37fc110c365 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:54.072069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46d237-4884-48e7-9478-f37fc110c365 admin admin] PATH_INFO: `/v3/projects/dc45be86bb394868b8d50f25802564d7/users/c2d8cf703b8842fdba4dc3960998a660/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:54.074313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46d237-4884-48e7-9478-f37fc110c365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc45be86bb394868b8d50f25802564d7, user_id=c2d8cf703b8842fdba4dc3960998a660, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:54.077583 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46d237-4884-48e7-9478-f37fc110c365 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:54.087439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe4527-ae1d-4937-bca0-1c185a5af6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:54.088805 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe4527-ae1d-4937-bca0-1c185a5af6e9 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:54.089249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe4527-ae1d-4937-bca0-1c185a5af6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:54.089730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe4527-ae1d-4937-bca0-1c185a5af6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:54.095365 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1227/2444] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:47:54 2021] PUT /identity/v3/projects/dc45be86bb394868b8d50f25802564d7/users/c2d8cf703b8842fdba4dc3960998a660/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:54.102202 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e13ef-097d-43d9-a0b0-2c4ac95db554 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:54.103051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e13ef-097d-43d9-a0b0-2c4ac95db554 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:54.103373 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e13ef-097d-43d9-a0b0-2c4ac95db554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:54.147685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-220e13ef-097d-43d9-a0b0-2c4ac95db554 None None] MFA Rules not processed for user `c2d8cf703b8842fdba4dc3960998a660`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:54.149626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-220e13ef-097d-43d9-a0b0-2c4ac95db554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:54.168330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe4527-ae1d-4937-bca0-1c185a5af6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:54.170253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe4527-ae1d-4937-bca0-1c185a5af6e9 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:54.188763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1218/2445] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:53 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:54.270986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1228/2446] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:54 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:54.292468 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe4527-ae1d-4937-bca0-1c185a5af6e9 service nova] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:54.297167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5ffe4527-ae1d-4937-bca0-1c185a5af6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:54.436155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe4527-ae1d-4937-bca0-1c185a5af6e9 service nova] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:54.502595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1344c6-df9b-4a41-b149-618eb2de9d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:54.503917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1344c6-df9b-4a41-b149-618eb2de9d76 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:54.504379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1344c6-df9b-4a41-b149-618eb2de9d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:54.504769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1344c6-df9b-4a41-b149-618eb2de9d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:54.520116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1344c6-df9b-4a41-b149-618eb2de9d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:54.521610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1344c6-df9b-4a41-b149-618eb2de9d76 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:54.536708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1219/2447] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:54 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:57.017488 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e13ef-097d-43d9-a0b0-2c4ac95db554 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:57.037560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e13ef-097d-43d9-a0b0-2c4ac95db554 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:57.053094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c08863-0b8f-4c2e-b80f-a9555a58cfd2 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d8cf703b8842fdba4dc3960998a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc45be86bb394868b8d50f25802564d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:57.054082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c08863-0b8f-4c2e-b80f-a9555a58cfd2 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:57.054541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c08863-0b8f-4c2e-b80f-a9555a58cfd2 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:57.054986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c08863-0b8f-4c2e-b80f-a9555a58cfd2 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:57.056049 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c08863-0b8f-4c2e-b80f-a9555a58cfd2 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:57.056558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c08863-0b8f-4c2e-b80f-a9555a58cfd2 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:57.058674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c08863-0b8f-4c2e-b80f-a9555a58cfd2 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:57.077663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1229/2448] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:47:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:57.081988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1344c6-df9b-4a41-b149-618eb2de9d76 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:57.093660 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1344c6-df9b-4a41-b149-618eb2de9d76 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:57.097933 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede36f-cc78-4f3a-8ad2-cbcf92a42a40 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d8cf703b8842fdba4dc3960998a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc45be86bb394868b8d50f25802564d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:57.100338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede36f-cc78-4f3a-8ad2-cbcf92a42a40 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:57.100338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede36f-cc78-4f3a-8ad2-cbcf92a42a40 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:57.100338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede36f-cc78-4f3a-8ad2-cbcf92a42a40 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:57.100338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ede36f-cc78-4f3a-8ad2-cbcf92a42a40 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:57.101908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ede36f-cc78-4f3a-8ad2-cbcf92a42a40 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:57.252773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1220/2449] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:47:57 2021] POST /identity/v3/projects => generated 354 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:57.253178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c08863-0b8f-4c2e-b80f-a9555a58cfd2 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:57.262094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c08863-0b8f-4c2e-b80f-a9555a58cfd2 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:57.424916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30fd7-66b6-4269-998e-72f043b16ad6 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d8cf703b8842fdba4dc3960998a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc45be86bb394868b8d50f25802564d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:57.425660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30fd7-66b6-4269-998e-72f043b16ad6 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:57.425955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30fd7-66b6-4269-998e-72f043b16ad6 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:57.426235 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30fd7-66b6-4269-998e-72f043b16ad6 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:57.427079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30fd7-66b6-4269-998e-72f043b16ad6 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:57.427470 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30fd7-66b6-4269-998e-72f043b16ad6 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:57.429558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30fd7-66b6-4269-998e-72f043b16ad6 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:57.443386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1230/2450] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:47:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:47:57.490394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede36f-cc78-4f3a-8ad2-cbcf92a42a40 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:57.508179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede36f-cc78-4f3a-8ad2-cbcf92a42a40 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:57.515170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d8cf703b8842fdba4dc3960998a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc45be86bb394868b8d50f25802564d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:57.516108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:57.516424 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:57.516850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] PATH_INFO: `/v3/projects/94e3d843c9e240d491c18dd21c4406f2` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:57.518327 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94e3d843c9e240d491c18dd21c4406f2)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:57.520305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:57.697212 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e3d843c9e240d491c18dd21c4406f2', 'request_id': 'req-e59d4a3a-76f2-422b-a27f-7b5899902d32'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:57.729548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e3d843c9e240d491c18dd21c4406f2', 'request_id': 'req-e59d4a3a-76f2-422b-a27f-7b5899902d32'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:57.733937 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e3d843c9e240d491c18dd21c4406f2', 'request_id': 'req-e59d4a3a-76f2-422b-a27f-7b5899902d32'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:57.849736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] The token cache is being invalidate because project 94e3d843c9e240d491c18dd21c4406f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:57.850059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:57.850740 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-e59d4a3a-76f2-422b-a27f-7b5899902d32 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:57.852886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1221/2451] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:47:57 2021] DELETE /identity/v3/projects/94e3d843c9e240d491c18dd21c4406f2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:58.715336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30fd7-66b6-4269-998e-72f043b16ad6 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:58.717416 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1af30fd7-66b6-4269-998e-72f043b16ad6 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:58.838021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30fd7-66b6-4269-998e-72f043b16ad6 tempest-VolumeQuotaClassesTest-1826063427 tempest-VolumeQuotaClassesTest-1826063427-project-admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:59.020901 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:59.021860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:59.022142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:59.022417 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] PATH_INFO: `/v3/users/77235af206c247ba959b7315dee4625f` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.023850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77235af206c247ba959b7315dee4625f)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:59.026646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:59.322172 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77235af206c247ba959b7315dee4625f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:59.323924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77235af206c247ba959b7315dee4625f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:59.324298 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77235af206c247ba959b7315dee4625f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:59.373096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77235af206c247ba959b7315dee4625f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:59.463348 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77235af206c247ba959b7315dee4625f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:59.490685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1231/2452] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:47:58 2021] DELETE /identity/v3/users/77235af206c247ba959b7315dee4625f => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:59.496057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83761b09-a7cb-4588-b202-2136c3e0b76a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:59.497516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83761b09-a7cb-4588-b202-2136c3e0b76a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:59.498094 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83761b09-a7cb-4588-b202-2136c3e0b76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.519768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-83761b09-a7cb-4588-b202-2136c3e0b76a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:59.521918 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-83761b09-a7cb-4588-b202-2136c3e0b76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:59.630879 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1222/2453] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:59.650554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:59.653763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:59.759521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5dbf1-6d4e-4bed-81b7-44f3c226a032 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:59.760111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5dbf1-6d4e-4bed-81b7-44f3c226a032 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:59.760430 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5dbf1-6d4e-4bed-81b7-44f3c226a032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.765603 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccc235-4fa1-498d-b0d9-48c7dfe29cc2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:59.769768 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8439-ee7c-4ec7-a340-4da15a92cc70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:59.770533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8439-ee7c-4ec7-a340-4da15a92cc70 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:59.770825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8439-ee7c-4ec7-a340-4da15a92cc70 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:59.771102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8439-ee7c-4ec7-a340-4da15a92cc70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.781421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec8439-ee7c-4ec7-a340-4da15a92cc70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:59.782948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec8439-ee7c-4ec7-a340-4da15a92cc70 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:59.783872 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-0af5dbf1-6d4e-4bed-81b7-44f3c226a032 None None] MFA Rules not processed for user `ffd9f61944414b4f886413ad331d4378`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:59.786059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0af5dbf1-6d4e-4bed-81b7-44f3c226a032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:59.794094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1232/2454] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:47:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:59.861932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1223/2455] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:47:59 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:00.789314 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8439-ee7c-4ec7-a340-4da15a92cc70 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:00.791451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-adec8439-ee7c-4ec7-a340-4da15a92cc70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:00.812242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8439-ee7c-4ec7-a340-4da15a92cc70 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:00.817571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:00.818862 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:00.819233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:00.819656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] PATH_INFO: `/v3/projects/fc6ab307f8554e67a3d4865214f5f6d5` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:00.821736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6ab307f8554e67a3d4865214f5f6d5)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:00.823872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:00.987685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6ab307f8554e67a3d4865214f5f6d5', 'request_id': 'req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:01.096466 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6ab307f8554e67a3d4865214f5f6d5', 'request_id': 'req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:01.098767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6ab307f8554e67a3d4865214f5f6d5', 'request_id': 'req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:01.114719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] The token cache is being invalidate because project fc6ab307f8554e67a3d4865214f5f6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:01.115026 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:01.116728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:01.124291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1233/2456] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:48:00 2021] DELETE /identity/v3/projects/fc6ab307f8554e67a3d4865214f5f6d5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:01.124728 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5dbf1-6d4e-4bed-81b7-44f3c226a032 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:01.139715 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5dbf1-6d4e-4bed-81b7-44f3c226a032 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:01.262102 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:01.262992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:01.263279 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:01.263577 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] PATH_INFO: `/v3/users/c2d8cf703b8842fdba4dc3960998a660` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:01.265691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d8cf703b8842fdba4dc3960998a660)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:01.267683 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:01.456302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d8cf703b8842fdba4dc3960998a660'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:01.470980 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d8cf703b8842fdba4dc3960998a660'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:01.471724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d8cf703b8842fdba4dc3960998a660'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:01.482545 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d8cf703b8842fdba4dc3960998a660'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:01.550063 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c302f7b0-d0ce-4852-a406-af861bbc3a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d8cf703b8842fdba4dc3960998a660'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:01.572485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1224/2457] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:48:01 2021] DELETE /identity/v3/users/c2d8cf703b8842fdba4dc3960998a660 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:02.090516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:02.090516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:02.106722 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b8850-6d96-4f3e-ad7b-cbfd5721ecbb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:02.181180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:02.182044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:02.182329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:02.182615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] PATH_INFO: `/v3/projects/dc45be86bb394868b8d50f25802564d7` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:02.183883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc45be86bb394868b8d50f25802564d7)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:02.185984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:02.346824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc45be86bb394868b8d50f25802564d7', 'request_id': 'req-667bdf1a-e3cc-4b67-878a-b2411636af5f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:02.416697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc45be86bb394868b8d50f25802564d7', 'request_id': 'req-667bdf1a-e3cc-4b67-878a-b2411636af5f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:02.423518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc45be86bb394868b8d50f25802564d7', 'request_id': 'req-667bdf1a-e3cc-4b67-878a-b2411636af5f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:02.439226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] The token cache is being invalidate because project dc45be86bb394868b8d50f25802564d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:02.439226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:02.440056 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-667bdf1a-e3cc-4b67-878a-b2411636af5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:02.441692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1234/2458] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:48:02 2021] DELETE /identity/v3/projects/dc45be86bb394868b8d50f25802564d7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:02.448845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ad61-959b-40fe-9deb-c415cf20915d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:02.449397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ad61-959b-40fe-9deb-c415cf20915d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:02.449397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ad61-959b-40fe-9deb-c415cf20915d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:02.470930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-0d81ad61-959b-40fe-9deb-c415cf20915d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:02.472578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0d81ad61-959b-40fe-9deb-c415cf20915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:02.542981 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1225/2459] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:02.550924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b27bf-f87e-443b-a1c1-cd0f17fd1a64 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:02.551281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b27bf-f87e-443b-a1c1-cd0f17fd1a64 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:02.551564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b27bf-f87e-443b-a1c1-cd0f17fd1a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:02.572941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b41b27bf-f87e-443b-a1c1-cd0f17fd1a64 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:02.574226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b41b27bf-f87e-443b-a1c1-cd0f17fd1a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:02.583421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1235/2460] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:02.588059 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ad61-959b-40fe-9deb-c415cf20915d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:02.601498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ad61-959b-40fe-9deb-c415cf20915d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:02.608081 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119c8f1-6173-44dd-97fb-f0f94010a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:02.608917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c8f1-6173-44dd-97fb-f0f94010a8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:02.609173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c8f1-6173-44dd-97fb-f0f94010a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:02.609476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c8f1-6173-44dd-97fb-f0f94010a8c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:02.610233 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119c8f1-6173-44dd-97fb-f0f94010a8c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:02.610551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119c8f1-6173-44dd-97fb-f0f94010a8c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:02.612201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119c8f1-6173-44dd-97fb-f0f94010a8c1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:02.624951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1226/2461] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:48:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:48:02.629390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b27bf-f87e-443b-a1c1-cd0f17fd1a64 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:02.639316 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b27bf-f87e-443b-a1c1-cd0f17fd1a64 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:02.644168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5e8f8-af34-4357-b4b1-44a5bd4a97fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:02.644793 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5e8f8-af34-4357-b4b1-44a5bd4a97fa admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:02.645076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5e8f8-af34-4357-b4b1-44a5bd4a97fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:02.645352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5e8f8-af34-4357-b4b1-44a5bd4a97fa admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:02.646033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5e8f8-af34-4357-b4b1-44a5bd4a97fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:02.647937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5e8f8-af34-4357-b4b1-44a5bd4a97fa admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:02.779059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1236/2462] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:48:02 2021] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:48:02.783200 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119c8f1-6173-44dd-97fb-f0f94010a8c1 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:02.793748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119c8f1-6173-44dd-97fb-f0f94010a8c1 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:02.854406 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479614-7db1-44cb-b33b-7845d469ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:02.854406 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479614-7db1-44cb-b33b-7845d469ce21 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:02.854654 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479614-7db1-44cb-b33b-7845d469ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:02.854863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479614-7db1-44cb-b33b-7845d469ce21 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:02.855548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08479614-7db1-44cb-b33b-7845d469ce21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:02.857491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08479614-7db1-44cb-b33b-7845d469ce21 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:02.971763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1227/2463] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:48:02 2021] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:02.976129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5e8f8-af34-4357-b4b1-44a5bd4a97fa admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:02.987144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5e8f8-af34-4357-b4b1-44a5bd4a97fa admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:02.991985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33c92c-b5f7-4a52-8342-ce01ad88ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:02.993047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33c92c-b5f7-4a52-8342-ce01ad88ccda admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:02.993047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33c92c-b5f7-4a52-8342-ce01ad88ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:02.993325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33c92c-b5f7-4a52-8342-ce01ad88ccda admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:02.993988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33c92c-b5f7-4a52-8342-ce01ad88ccda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:02.995631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33c92c-b5f7-4a52-8342-ce01ad88ccda admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:03.006481 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1237/2464] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:03.011112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479614-7db1-44cb-b33b-7845d469ce21 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:03.021745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479614-7db1-44cb-b33b-7845d469ce21 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:03.027349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94485f-0308-42fe-8d79-227a4bc221d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:03.028052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94485f-0308-42fe-8d79-227a4bc221d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:03.028336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94485f-0308-42fe-8d79-227a4bc221d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:03.028655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94485f-0308-42fe-8d79-227a4bc221d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:03.029536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94485f-0308-42fe-8d79-227a4bc221d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:03.031146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94485f-0308-42fe-8d79-227a4bc221d1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:03.041938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1228/2465] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:03.046118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33c92c-b5f7-4a52-8342-ce01ad88ccda admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:03.056033 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33c92c-b5f7-4a52-8342-ce01ad88ccda admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:03.060667 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35314f2-c2bf-46e0-9079-b1d1ff87ac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:03.061541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35314f2-c2bf-46e0-9079-b1d1ff87ac2f admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:03.061822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35314f2-c2bf-46e0-9079-b1d1ff87ac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:03.062093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35314f2-c2bf-46e0-9079-b1d1ff87ac2f admin admin] PATH_INFO: `/v3/projects/673c2cda310b4c38a68da501ccb610bd/users/1c5c9d9d186e4fc7a8b8fb702359ba27/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:03.076845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35314f2-c2bf-46e0-9079-b1d1ff87ac2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=673c2cda310b4c38a68da501ccb610bd, user_id=1c5c9d9d186e4fc7a8b8fb702359ba27, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:03.079545 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35314f2-c2bf-46e0-9079-b1d1ff87ac2f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:03.154945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1238/2466] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:48:03 2021] PUT /identity/v3/projects/673c2cda310b4c38a68da501ccb610bd/users/1c5c9d9d186e4fc7a8b8fb702359ba27/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:03.165470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5caab-332e-4e59-9efd-3032da840c89 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:03.165756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5caab-332e-4e59-9efd-3032da840c89 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:03.166029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5caab-332e-4e59-9efd-3032da840c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:03.192095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-20d5caab-332e-4e59-9efd-3032da840c89 None None] MFA Rules not processed for user `1c5c9d9d186e4fc7a8b8fb702359ba27`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:03.192811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-20d5caab-332e-4e59-9efd-3032da840c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:03.262795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1229/2467] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:03 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:03.267328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35314f2-c2bf-46e0-9079-b1d1ff87ac2f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:03.333549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35314f2-c2bf-46e0-9079-b1d1ff87ac2f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:03.338987 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1a4f-832b-4468-8ee9-22c7fd27196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:03.339650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1a4f-832b-4468-8ee9-22c7fd27196e admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:03.339936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1a4f-832b-4468-8ee9-22c7fd27196e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:03.340214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1a4f-832b-4468-8ee9-22c7fd27196e admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:03.341022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c1a4f-832b-4468-8ee9-22c7fd27196e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:03.343018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c1a4f-832b-4468-8ee9-22c7fd27196e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:03.429799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1239/2468] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:48:03 2021] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:48:03.433995 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5caab-332e-4e59-9efd-3032da840c89 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:03.447608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5caab-332e-4e59-9efd-3032da840c89 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:03.515800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce251661-f664-4b4d-99bc-c69ad18bc931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:03.516520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251661-f664-4b4d-99bc-c69ad18bc931 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:03.516777 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251661-f664-4b4d-99bc-c69ad18bc931 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:03.517056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251661-f664-4b4d-99bc-c69ad18bc931 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:03.517767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce251661-f664-4b4d-99bc-c69ad18bc931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:03.519676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce251661-f664-4b4d-99bc-c69ad18bc931 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:03.599285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1230/2469] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:48:03 2021] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:48:03.603253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1a4f-832b-4468-8ee9-22c7fd27196e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:03.613471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1a4f-832b-4468-8ee9-22c7fd27196e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:03.618493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5c1ea-a458-4c52-a44a-c751bfb202db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:03.619161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5c1ea-a458-4c52-a44a-c751bfb202db admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:03.619444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5c1ea-a458-4c52-a44a-c751bfb202db admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:03.619723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5c1ea-a458-4c52-a44a-c751bfb202db admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:03.620486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5c1ea-a458-4c52-a44a-c751bfb202db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:03.622091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5c1ea-a458-4c52-a44a-c751bfb202db admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:03.637868 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1240/2470] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:03.639107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce251661-f664-4b4d-99bc-c69ad18bc931 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:03.649779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce251661-f664-4b4d-99bc-c69ad18bc931 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:03.655148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46fd32-27f0-428e-95ca-ea16025bee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:03.656044 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46fd32-27f0-428e-95ca-ea16025bee5e admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:03.656310 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46fd32-27f0-428e-95ca-ea16025bee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:03.656612 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46fd32-27f0-428e-95ca-ea16025bee5e admin admin] PATH_INFO: `/v3/projects/9980ab70f86e47d8a606afe666d6271b/users/b0ec4263b7c84e9882515a1fca7039f0/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:03.671199 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46fd32-27f0-428e-95ca-ea16025bee5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9980ab70f86e47d8a606afe666d6271b, user_id=b0ec4263b7c84e9882515a1fca7039f0, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:03.673894 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46fd32-27f0-428e-95ca-ea16025bee5e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:03.748711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1231/2471] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:48:03 2021] PUT /identity/v3/projects/9980ab70f86e47d8a606afe666d6271b/users/b0ec4263b7c84e9882515a1fca7039f0/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:03.752841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5c1ea-a458-4c52-a44a-c751bfb202db admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:03.764007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5c1ea-a458-4c52-a44a-c751bfb202db admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:03.825821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c889d-3f21-479e-8666-40862b436c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:03.826486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c889d-3f21-479e-8666-40862b436c10 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:03.826765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c889d-3f21-479e-8666-40862b436c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:03.827039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c889d-3f21-479e-8666-40862b436c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:03.827757 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c889d-3f21-479e-8666-40862b436c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:03.829376 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c889d-3f21-479e-8666-40862b436c10 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:03.839004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1241/2472] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:03 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:03.843217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46fd32-27f0-428e-95ca-ea16025bee5e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:03.853568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46fd32-27f0-428e-95ca-ea16025bee5e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:03.858138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5d7b9-75c8-4f4c-bc66-b0ce14c52b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:03.859019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5d7b9-75c8-4f4c-bc66-b0ce14c52b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:03.859299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5d7b9-75c8-4f4c-bc66-b0ce14c52b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:03.859571 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5d7b9-75c8-4f4c-bc66-b0ce14c52b30 admin admin] PATH_INFO: `/v3/projects/9980ab70f86e47d8a606afe666d6271b/users/b0ec4263b7c84e9882515a1fca7039f0/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:03.861676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5d7b9-75c8-4f4c-bc66-b0ce14c52b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9980ab70f86e47d8a606afe666d6271b, user_id=b0ec4263b7c84e9882515a1fca7039f0, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:03.864410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5d7b9-75c8-4f4c-bc66-b0ce14c52b30 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:03.875619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1232/2473] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:48:03 2021] PUT /identity/v3/projects/9980ab70f86e47d8a606afe666d6271b/users/b0ec4263b7c84e9882515a1fca7039f0/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:03.887544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f98e-d290-44c1-8831-3a0542bd1ba7 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:03.887880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f98e-d290-44c1-8831-3a0542bd1ba7 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:03.888123 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f98e-d290-44c1-8831-3a0542bd1ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:03.917336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-a167f98e-d290-44c1-8831-3a0542bd1ba7 None None] MFA Rules not processed for user `b0ec4263b7c84e9882515a1fca7039f0`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:03.918548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a167f98e-d290-44c1-8831-3a0542bd1ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:03.984941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1242/2474] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:03 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:03.995327 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5d7b9-75c8-4f4c-bc66-b0ce14c52b30 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:03.997076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-56c5d7b9-75c8-4f4c-bc66-b0ce14c52b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:04.051401 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5d7b9-75c8-4f4c-bc66-b0ce14c52b30 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:04.055526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04dc96-a80b-47ab-9f61-c90750861fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:04.056159 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04dc96-a80b-47ab-9f61-c90750861fcb service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:04.056466 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04dc96-a80b-47ab-9f61-c90750861fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:04.056740 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04dc96-a80b-47ab-9f61-c90750861fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:04.065661 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04dc96-a80b-47ab-9f61-c90750861fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:04.067064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04dc96-a80b-47ab-9f61-c90750861fcb service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:04.079912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1233/2475] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:03 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:04.191749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f98e-d290-44c1-8831-3a0542bd1ba7 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:04.213759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f98e-d290-44c1-8831-3a0542bd1ba7 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:04.217364 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959e155-37d5-49fb-bde1-4406032f13c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:04.217997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e155-37d5-49fb-bde1-4406032f13c7 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:04.218280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e155-37d5-49fb-bde1-4406032f13c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:04.218557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e155-37d5-49fb-bde1-4406032f13c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:04.273465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959e155-37d5-49fb-bde1-4406032f13c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:04.274830 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959e155-37d5-49fb-bde1-4406032f13c7 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:04.284128 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1243/2476] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:04 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:07.309687 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04dc96-a80b-47ab-9f61-c90750861fcb service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:07.400580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04dc96-a80b-47ab-9f61-c90750861fcb service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:07.405443 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:07.420862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:07.420862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:07.420862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] PATH_INFO: `/v3/users/1c5c9d9d186e4fc7a8b8fb702359ba27` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:07.420862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5c9d9d186e4fc7a8b8fb702359ba27)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:07.420862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:07.694557 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5c9d9d186e4fc7a8b8fb702359ba27'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:07.711176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5c9d9d186e4fc7a8b8fb702359ba27'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:07.711832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5c9d9d186e4fc7a8b8fb702359ba27'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:07.732387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5c9d9d186e4fc7a8b8fb702359ba27'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:07.868281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5c9d9d186e4fc7a8b8fb702359ba27'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:07.868281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1234/2477] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:48:07 2021] DELETE /identity/v3/users/1c5c9d9d186e4fc7a8b8fb702359ba27 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:07.869174 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1d6c1-8e7e-4a32-8a3e-21956ef92235 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:07.869645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1d6c1-8e7e-4a32-8a3e-21956ef92235 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:07.869797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1d6c1-8e7e-4a32-8a3e-21956ef92235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:07.890354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c6e1d6c1-8e7e-4a32-8a3e-21956ef92235 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:07.891971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c6e1d6c1-8e7e-4a32-8a3e-21956ef92235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:07.955695 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1244/2478] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:07.966353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:07.968993 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:08.045471 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad095f4-93a3-4a12-b1d6-f07cd7ad5deb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:08.049551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906e1e8-2315-45af-86e1-3c351ed7b671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:08.050247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906e1e8-2315-45af-86e1-3c351ed7b671 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:08.050532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906e1e8-2315-45af-86e1-3c351ed7b671 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:08.050815 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906e1e8-2315-45af-86e1-3c351ed7b671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:08.062678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906e1e8-2315-45af-86e1-3c351ed7b671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:08.064347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906e1e8-2315-45af-86e1-3c351ed7b671 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:08.075222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1235/2479] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:08.584048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1d6c1-8e7e-4a32-8a3e-21956ef92235 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:08.585502 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c6e1d6c1-8e7e-4a32-8a3e-21956ef92235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:08.598154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1d6c1-8e7e-4a32-8a3e-21956ef92235 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:08.602878 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:08.606182 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:08.606182 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:08.606182 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] PATH_INFO: `/v3/projects/673c2cda310b4c38a68da501ccb610bd` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:08.606182 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] RBAC: Authorizing `identity:delete_project(project_id=673c2cda310b4c38a68da501ccb610bd)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:08.607491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:08.725869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673c2cda310b4c38a68da501ccb610bd', 'request_id': 'req-0ab1becd-bda8-496b-9bbc-a219ec5f384b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:08.787793 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673c2cda310b4c38a68da501ccb610bd', 'request_id': 'req-0ab1becd-bda8-496b-9bbc-a219ec5f384b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:08.794311 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673c2cda310b4c38a68da501ccb610bd', 'request_id': 'req-0ab1becd-bda8-496b-9bbc-a219ec5f384b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:08.805955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] The token cache is being invalidate because project 673c2cda310b4c38a68da501ccb610bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:08.806246 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:08.806880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:08.808460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1245/2480] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:48:08 2021] DELETE /identity/v3/projects/673c2cda310b4c38a68da501ccb610bd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:08.812488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906e1e8-2315-45af-86e1-3c351ed7b671 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:08.822035 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906e1e8-2315-45af-86e1-3c351ed7b671 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:08.877988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:08.878893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:08.879176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:08.879457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] PATH_INFO: `/v3/users/b0ec4263b7c84e9882515a1fca7039f0` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:08.880737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ec4263b7c84e9882515a1fca7039f0)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:08.882677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:09.063853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ec4263b7c84e9882515a1fca7039f0'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.076026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ec4263b7c84e9882515a1fca7039f0'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.076823 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ec4263b7c84e9882515a1fca7039f0'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.083724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ec4263b7c84e9882515a1fca7039f0'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.228622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7156acdb-60fc-44f3-a9c3-92982f62d7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ec4263b7c84e9882515a1fca7039f0'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.235241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1236/2481] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:48:08 2021] DELETE /identity/v3/users/b0ec4263b7c84e9882515a1fca7039f0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:09.691048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:09.696392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:09.710748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1becd-bda8-496b-9bbc-a219ec5f384b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:09.778495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:09.779344 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:09.779626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:09.779896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] PATH_INFO: `/v3/projects/9980ab70f86e47d8a606afe666d6271b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:09.781167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9980ab70f86e47d8a606afe666d6271b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:09.784914 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:09.916865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9980ab70f86e47d8a606afe666d6271b', 'request_id': 'req-6fdfceda-0359-46ef-a61e-a60ed8bff178'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.992619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9980ab70f86e47d8a606afe666d6271b', 'request_id': 'req-6fdfceda-0359-46ef-a61e-a60ed8bff178'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.999197 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9980ab70f86e47d8a606afe666d6271b', 'request_id': 'req-6fdfceda-0359-46ef-a61e-a60ed8bff178'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:10.013657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] The token cache is being invalidate because project 9980ab70f86e47d8a606afe666d6271b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:10.013958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:10.014637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6fdfceda-0359-46ef-a61e-a60ed8bff178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:10.021580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1246/2482] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:48:09 2021] DELETE /identity/v3/projects/9980ab70f86e47d8a606afe666d6271b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:10.023100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b119136-3bcf-4ed3-b8bd-d69fe0acfadf None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.024093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b119136-3bcf-4ed3-b8bd-d69fe0acfadf None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.024173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b119136-3bcf-4ed3-b8bd-d69fe0acfadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.053499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-8b119136-3bcf-4ed3-b8bd-d69fe0acfadf None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:10.055213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8b119136-3bcf-4ed3-b8bd-d69fe0acfadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:10.124510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1237/2483] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:10.132525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fcdde-bd38-4b9c-ab0b-ee286ff2d41d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.133340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fcdde-bd38-4b9c-ab0b-ee286ff2d41d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.139694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fcdde-bd38-4b9c-ab0b-ee286ff2d41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.154685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-165fcdde-bd38-4b9c-ab0b-ee286ff2d41d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:10.155925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-165fcdde-bd38-4b9c-ab0b-ee286ff2d41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:10.168915 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1247/2484] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:10.174189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b119136-3bcf-4ed3-b8bd-d69fe0acfadf None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.185917 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b119136-3bcf-4ed3-b8bd-d69fe0acfadf None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.191267 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a852a48-7c26-4956-bcf2-87fc49972b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.191989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a852a48-7c26-4956-bcf2-87fc49972b0e admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.192272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a852a48-7c26-4956-bcf2-87fc49972b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.192655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a852a48-7c26-4956-bcf2-87fc49972b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.193416 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a852a48-7c26-4956-bcf2-87fc49972b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:10.193744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a852a48-7c26-4956-bcf2-87fc49972b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.195852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a852a48-7c26-4956-bcf2-87fc49972b0e admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.207547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1238/2485] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:48:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:10.212708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fcdde-bd38-4b9c-ab0b-ee286ff2d41d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.221892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fcdde-bd38-4b9c-ab0b-ee286ff2d41d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.226681 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d530430-9618-4b41-83b3-7a7fbfec10fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.227339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530430-9618-4b41-83b3-7a7fbfec10fe admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.227682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530430-9618-4b41-83b3-7a7fbfec10fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.227963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530430-9618-4b41-83b3-7a7fbfec10fe admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.228604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d530430-9618-4b41-83b3-7a7fbfec10fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.230521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d530430-9618-4b41-83b3-7a7fbfec10fe admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.428903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1248/2486] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:48:10 2021] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:48:10.433280 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a852a48-7c26-4956-bcf2-87fc49972b0e admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.443242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a852a48-7c26-4956-bcf2-87fc49972b0e admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.509003 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da683e-3f2e-444f-98c9-eda745828463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.509831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da683e-3f2e-444f-98c9-eda745828463 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.510116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da683e-3f2e-444f-98c9-eda745828463 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.510391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da683e-3f2e-444f-98c9-eda745828463 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.511089 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da683e-3f2e-444f-98c9-eda745828463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.513098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da683e-3f2e-444f-98c9-eda745828463 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.614446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1239/2487] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:48:10 2021] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:48:10.615902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d530430-9618-4b41-83b3-7a7fbfec10fe admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.627228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d530430-9618-4b41-83b3-7a7fbfec10fe admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.632027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed50da0-3301-4b75-b218-f6fe0e660c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.633403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed50da0-3301-4b75-b218-f6fe0e660c14 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.633679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed50da0-3301-4b75-b218-f6fe0e660c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.633953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed50da0-3301-4b75-b218-f6fe0e660c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.635001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed50da0-3301-4b75-b218-f6fe0e660c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.636683 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed50da0-3301-4b75-b218-f6fe0e660c14 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.648102 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1249/2488] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:10 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:10.654065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da683e-3f2e-444f-98c9-eda745828463 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.664256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da683e-3f2e-444f-98c9-eda745828463 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.668819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1a67b-4a73-4a7d-a2d3-4e61561638f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.669484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1a67b-4a73-4a7d-a2d3-4e61561638f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.669763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1a67b-4a73-4a7d-a2d3-4e61561638f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.670036 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1a67b-4a73-4a7d-a2d3-4e61561638f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.670753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1a67b-4a73-4a7d-a2d3-4e61561638f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.672490 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1a67b-4a73-4a7d-a2d3-4e61561638f1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.685191 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1240/2489] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:10.689533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed50da0-3301-4b75-b218-f6fe0e660c14 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.701871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed50da0-3301-4b75-b218-f6fe0e660c14 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.706727 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e29a7-21ac-4368-b7ba-a5d8f9f32f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.707609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e29a7-21ac-4368-b7ba-a5d8f9f32f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.707932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e29a7-21ac-4368-b7ba-a5d8f9f32f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.708141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e29a7-21ac-4368-b7ba-a5d8f9f32f00 admin admin] PATH_INFO: `/v3/projects/6eea3805e36a4b48bb8153d9d4390827/users/0588c2ddb3564fb4a94e11a2b07d0e8e/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.723767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e29a7-21ac-4368-b7ba-a5d8f9f32f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eea3805e36a4b48bb8153d9d4390827, user_id=0588c2ddb3564fb4a94e11a2b07d0e8e, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.726553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e29a7-21ac-4368-b7ba-a5d8f9f32f00 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.873422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1250/2490] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:48:10 2021] PUT /identity/v3/projects/6eea3805e36a4b48bb8153d9d4390827/users/0588c2ddb3564fb4a94e11a2b07d0e8e/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:10.883734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249907f-f970-4165-8e6d-6a32b251e632 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.884026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249907f-f970-4165-8e6d-6a32b251e632 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.884601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249907f-f970-4165-8e6d-6a32b251e632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.911929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-6249907f-f970-4165-8e6d-6a32b251e632 None None] MFA Rules not processed for user `0588c2ddb3564fb4a94e11a2b07d0e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:10.913202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6249907f-f970-4165-8e6d-6a32b251e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:10.988078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1241/2491] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:10 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:10.999735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e29a7-21ac-4368-b7ba-a5d8f9f32f00 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:11.001508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-733e29a7-21ac-4368-b7ba-a5d8f9f32f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:11.073808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e29a7-21ac-4368-b7ba-a5d8f9f32f00 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:11.078472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086559b-a43a-4aa7-95f4-4961e53af301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:11.079085 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086559b-a43a-4aa7-95f4-4961e53af301 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:11.079387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086559b-a43a-4aa7-95f4-4961e53af301 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:11.079666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086559b-a43a-4aa7-95f4-4961e53af301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:11.090068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086559b-a43a-4aa7-95f4-4961e53af301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:11.091619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086559b-a43a-4aa7-95f4-4961e53af301 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:11.116516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1251/2492] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:10 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:11.123204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249907f-f970-4165-8e6d-6a32b251e632 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:11.194041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249907f-f970-4165-8e6d-6a32b251e632 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:11.198761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:11.199638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:11.199923 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:11.200194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] PATH_INFO: `/v3/users/0588c2ddb3564fb4a94e11a2b07d0e8e` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:11.201463 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0588c2ddb3564fb4a94e11a2b07d0e8e)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:11.203372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:11.357257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086559b-a43a-4aa7-95f4-4961e53af301 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:11.358599 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3086559b-a43a-4aa7-95f4-4961e53af301 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:11.372690 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086559b-a43a-4aa7-95f4-4961e53af301 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:11.377351 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:11.378205 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:11.378487 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:11.378761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] PATH_INFO: `/v3/users/0ee3e17bff0f42848cbc261d1d93ae28` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:11.379943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee3e17bff0f42848cbc261d1d93ae28)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:11.381928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:11.430095 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0588c2ddb3564fb4a94e11a2b07d0e8e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:11.441834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0588c2ddb3564fb4a94e11a2b07d0e8e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:11.442772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0588c2ddb3564fb4a94e11a2b07d0e8e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:11.449548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0588c2ddb3564fb4a94e11a2b07d0e8e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:11.519428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-83db3e61-6863-475a-96f0-6fa1b82c87d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0588c2ddb3564fb4a94e11a2b07d0e8e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:11.526626 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1242/2493] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:48:11 2021] DELETE /identity/v3/users/0588c2ddb3564fb4a94e11a2b07d0e8e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:11.531261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420bd64-b551-417e-9062-8344836d6262 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:11.531555 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420bd64-b551-417e-9062-8344836d6262 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:11.531835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420bd64-b551-417e-9062-8344836d6262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:11.557042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-0420bd64-b551-417e-9062-8344836d6262 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:11.557042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0420bd64-b551-417e-9062-8344836d6262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:11.612557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee3e17bff0f42848cbc261d1d93ae28'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:11.612969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1243/2494] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:11.616724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee3e17bff0f42848cbc261d1d93ae28'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:11.617254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee3e17bff0f42848cbc261d1d93ae28'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:11.623129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420bd64-b551-417e-9062-8344836d6262 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:11.624796 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0420bd64-b551-417e-9062-8344836d6262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:11.630143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee3e17bff0f42848cbc261d1d93ae28'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:11.683264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420bd64-b551-417e-9062-8344836d6262 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:11.687066 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef3fe-09da-4b70-8f03-26c82cc6d2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:11.687720 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef3fe-09da-4b70-8f03-26c82cc6d2be service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:11.688004 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef3fe-09da-4b70-8f03-26c82cc6d2be service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:11.688277 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef3fe-09da-4b70-8f03-26c82cc6d2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:11.690085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-52aef3fe-09da-4b70-8f03-26c82cc6d2be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:11.703460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef3fe-09da-4b70-8f03-26c82cc6d2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:11.704965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef3fe-09da-4b70-8f03-26c82cc6d2be service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:11.707809 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee3e17bff0f42848cbc261d1d93ae28'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:11.715556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1244/2495] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:48:11.722878 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1252/2496] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:48:11 2021] DELETE /identity/v3/users/0ee3e17bff0f42848cbc261d1d93ae28 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:11.727201 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d0daa-51f5-4ef9-950d-ca464143444c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:11.727490 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d0daa-51f5-4ef9-950d-ca464143444c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:11.727764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d0daa-51f5-4ef9-950d-ca464143444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:11.746421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-026d0daa-51f5-4ef9-950d-ca464143444c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:11.747700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-026d0daa-51f5-4ef9-950d-ca464143444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:11.808550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1245/2497] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:11.818046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:11.819479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:11.883465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074e2ba-53ed-47c5-bbbe-5ec9a34dde9d admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:11.887411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f1d4a-5fe9-4941-99d6-acd14c11fd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:11.888059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1d4a-5fe9-4941-99d6-acd14c11fd58 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:11.888340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1d4a-5fe9-4941-99d6-acd14c11fd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:11.888671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1d4a-5fe9-4941-99d6-acd14c11fd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:11.897894 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f1d4a-5fe9-4941-99d6-acd14c11fd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:11.899900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f1d4a-5fe9-4941-99d6-acd14c11fd58 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:11.909936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1253/2498] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:12.261049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d0daa-51f5-4ef9-950d-ca464143444c None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:12.263300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-026d0daa-51f5-4ef9-950d-ca464143444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:12.278631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d0daa-51f5-4ef9-950d-ca464143444c None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:12.285667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:12.286764 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:12.287357 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:12.287975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] PATH_INFO: `/v3/projects/6eea3805e36a4b48bb8153d9d4390827` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:12.294324 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eea3805e36a4b48bb8153d9d4390827)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:12.296532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:12.436819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eea3805e36a4b48bb8153d9d4390827', 'request_id': 'req-128b7976-6ee2-4994-98d4-4a36c8d80abf'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:12.445461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eea3805e36a4b48bb8153d9d4390827', 'request_id': 'req-128b7976-6ee2-4994-98d4-4a36c8d80abf'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:12.454808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eea3805e36a4b48bb8153d9d4390827', 'request_id': 'req-128b7976-6ee2-4994-98d4-4a36c8d80abf'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:12.502929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f1d4a-5fe9-4941-99d6-acd14c11fd58 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:12.507489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-861f1d4a-5fe9-4941-99d6-acd14c11fd58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:12.540022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f1d4a-5fe9-4941-99d6-acd14c11fd58 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:12.595671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:12.596625 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:12.596913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:12.597215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] PATH_INFO: `/v3/projects/ff2c23ed82b74574953416ade731ee94` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:12.598425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2c23ed82b74574953416ade731ee94)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:12.600493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:12.615502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] The token cache is being invalidate because project 6eea3805e36a4b48bb8153d9d4390827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:12.615502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:12.615502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-128b7976-6ee2-4994-98d4-4a36c8d80abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:12.615502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1246/2499] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:48:12 2021] DELETE /identity/v3/projects/6eea3805e36a4b48bb8153d9d4390827 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:12.627469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff57681-c6da-416f-9bbe-bb9b66f6059a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:12.627857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff57681-c6da-416f-9bbe-bb9b66f6059a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:12.628234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff57681-c6da-416f-9bbe-bb9b66f6059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:12.646942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4ff57681-c6da-416f-9bbe-bb9b66f6059a None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:12.648261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4ff57681-c6da-416f-9bbe-bb9b66f6059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:12.656210 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1247/2500] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:12.668743 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e8c8-d945-4bca-9444-418ef5fcdcbb None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:12.669026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e8c8-d945-4bca-9444-418ef5fcdcbb None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:12.669303 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e8c8-d945-4bca-9444-418ef5fcdcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:12.689487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a278e8c8-d945-4bca-9444-418ef5fcdcbb None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:12.695007 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a278e8c8-d945-4bca-9444-418ef5fcdcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:12.705022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1248/2501] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:12.709354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e8c8-d945-4bca-9444-418ef5fcdcbb None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:12.719309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e8c8-d945-4bca-9444-418ef5fcdcbb None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:12.724116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0285b8-dc6b-415a-8cdc-830775befc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:12.724886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0285b8-dc6b-415a-8cdc-830775befc30 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:12.725169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0285b8-dc6b-415a-8cdc-830775befc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:12.725450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0285b8-dc6b-415a-8cdc-830775befc30 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:12.726220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0285b8-dc6b-415a-8cdc-830775befc30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:12.727146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0285b8-dc6b-415a-8cdc-830775befc30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:12.728695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0285b8-dc6b-415a-8cdc-830775befc30 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:12.740762 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1249/2502] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:48:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:48:12.745081 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0285b8-dc6b-415a-8cdc-830775befc30 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:12.756252 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0285b8-dc6b-415a-8cdc-830775befc30 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:12.768941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2c23ed82b74574953416ade731ee94', 'request_id': 'req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:12.821492 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178469d1-3b64-4bc4-a873-bd29c33c97a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:12.822170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178469d1-3b64-4bc4-a873-bd29c33c97a2 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:12.822468 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178469d1-3b64-4bc4-a873-bd29c33c97a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:12.822750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178469d1-3b64-4bc4-a873-bd29c33c97a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:12.823594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178469d1-3b64-4bc4-a873-bd29c33c97a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:12.825489 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178469d1-3b64-4bc4-a873-bd29c33c97a2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:12.918580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2c23ed82b74574953416ade731ee94', 'request_id': 'req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:12.938580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2c23ed82b74574953416ade731ee94', 'request_id': 'req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:12.943637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] The token cache is being invalidate because project ff2c23ed82b74574953416ade731ee94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:12.943926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:12.944633 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8f7153c5-70a9-4c7a-be4d-634aa30fad4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:12.946335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1254/2503] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:48:12 2021] DELETE /identity/v3/projects/ff2c23ed82b74574953416ade731ee94 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:12.952645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b8388-a3f9-4f04-9f26-b3348330e2b0 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:12.952934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b8388-a3f9-4f04-9f26-b3348330e2b0 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:12.953213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b8388-a3f9-4f04-9f26-b3348330e2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:12.973032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-326b8388-a3f9-4f04-9f26-b3348330e2b0 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:12.974244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-326b8388-a3f9-4f04-9f26-b3348330e2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:12.987848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1255/2504] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:12.997050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b105131-53d9-4cce-89f7-039afa66ed9b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:12.997326 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b105131-53d9-4cce-89f7-039afa66ed9b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:12.997605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b105131-53d9-4cce-89f7-039afa66ed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.016913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7b105131-53d9-4cce-89f7-039afa66ed9b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:13.018142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7b105131-53d9-4cce-89f7-039afa66ed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:13.027157 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1256/2505] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:13.032300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b105131-53d9-4cce-89f7-039afa66ed9b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.046761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b105131-53d9-4cce-89f7-039afa66ed9b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.051736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61755a3-5cb3-4e1e-be93-5c44c9f4f4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:13.052458 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61755a3-5cb3-4e1e-be93-5c44c9f4f4ef admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.052743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61755a3-5cb3-4e1e-be93-5c44c9f4f4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.053022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61755a3-5cb3-4e1e-be93-5c44c9f4f4ef admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.053765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61755a3-5cb3-4e1e-be93-5c44c9f4f4ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:13.054073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61755a3-5cb3-4e1e-be93-5c44c9f4f4ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:13.055751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61755a3-5cb3-4e1e-be93-5c44c9f4f4ef admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.069136 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1257/2506] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:48:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:48:13.075081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61755a3-5cb3-4e1e-be93-5c44c9f4f4ef admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.081143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1250/2507] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:48:12 2021] POST /identity/v3/projects => generated 367 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:48:13.087734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178469d1-3b64-4bc4-a873-bd29c33c97a2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.090264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-178469d1-3b64-4bc4-a873-bd29c33c97a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:13.091130 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61755a3-5cb3-4e1e-be93-5c44c9f4f4ef admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.155635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f7a40-e30d-4612-8648-6d62d3316b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:13.156339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f7a40-e30d-4612-8648-6d62d3316b32 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.156665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f7a40-e30d-4612-8648-6d62d3316b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.156940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f7a40-e30d-4612-8648-6d62d3316b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.157643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f7a40-e30d-4612-8648-6d62d3316b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:13.159610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f7a40-e30d-4612-8648-6d62d3316b32 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.163485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178469d1-3b64-4bc4-a873-bd29c33c97a2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.168967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726ed4-7cce-4329-a61c-dc9a607bf624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:13.169667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726ed4-7cce-4329-a61c-dc9a607bf624 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.169941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726ed4-7cce-4329-a61c-dc9a607bf624 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.175647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726ed4-7cce-4329-a61c-dc9a607bf624 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.175647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22726ed4-7cce-4329-a61c-dc9a607bf624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:13.175647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22726ed4-7cce-4329-a61c-dc9a607bf624 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.302014 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1258/2508] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:48:13 2021] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:13.303437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f7a40-e30d-4612-8648-6d62d3316b32 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.327523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1251/2509] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:48:13 2021] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:13.337222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726ed4-7cce-4329-a61c-dc9a607bf624 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.349857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726ed4-7cce-4329-a61c-dc9a607bf624 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.427737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f7a40-e30d-4612-8648-6d62d3316b32 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.434522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507c3fc-eeb8-4fcb-b888-14393f8e3034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:13.435378 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c3fc-eeb8-4fcb-b888-14393f8e3034 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.435654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c3fc-eeb8-4fcb-b888-14393f8e3034 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.435931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c3fc-eeb8-4fcb-b888-14393f8e3034 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.436671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507c3fc-eeb8-4fcb-b888-14393f8e3034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:13.439143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507c3fc-eeb8-4fcb-b888-14393f8e3034 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.446710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69f9ce-d0c1-404d-809f-081567624524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:13.447809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f9ce-d0c1-404d-809f-081567624524 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.448149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f9ce-d0c1-404d-809f-081567624524 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.458531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f9ce-d0c1-404d-809f-081567624524 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.458531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69f9ce-d0c1-404d-809f-081567624524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:13.458531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69f9ce-d0c1-404d-809f-081567624524 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.465733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1252/2510] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:13 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:48:13.469016 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69f9ce-d0c1-404d-809f-081567624524 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.479856 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69f9ce-d0c1-404d-809f-081567624524 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.487410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6fa70-ec6c-4056-b4f1-35fe433328ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:13.487410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6fa70-ec6c-4056-b4f1-35fe433328ff admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.487410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6fa70-ec6c-4056-b4f1-35fe433328ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.487410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6fa70-ec6c-4056-b4f1-35fe433328ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.487815 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6fa70-ec6c-4056-b4f1-35fe433328ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:13.489499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6fa70-ec6c-4056-b4f1-35fe433328ff admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.501630 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1253/2511] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:13 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:13.506013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6fa70-ec6c-4056-b4f1-35fe433328ff admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.518294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6fa70-ec6c-4056-b4f1-35fe433328ff admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.523779 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328fb6-25f8-4dcd-ba35-8ae19bbe0cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:13.524713 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328fb6-25f8-4dcd-ba35-8ae19bbe0cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.525000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328fb6-25f8-4dcd-ba35-8ae19bbe0cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.525284 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328fb6-25f8-4dcd-ba35-8ae19bbe0cbf admin admin] PATH_INFO: `/v3/projects/1b5b248e232740e0b2f4072492ec0b45/users/684779ffbf5a46cdbe7b4def7cb23ead/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.544789 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc328fb6-25f8-4dcd-ba35-8ae19bbe0cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5b248e232740e0b2f4072492ec0b45, user_id=684779ffbf5a46cdbe7b4def7cb23ead, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:13.546608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc328fb6-25f8-4dcd-ba35-8ae19bbe0cbf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.605962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1259/2512] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:48:13 2021] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:13.611135 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507c3fc-eeb8-4fcb-b888-14393f8e3034 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.630331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507c3fc-eeb8-4fcb-b888-14393f8e3034 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.639948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc62b6-2b76-414e-9daa-7fac47bbec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:13.641271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc62b6-2b76-414e-9daa-7fac47bbec05 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.641846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc62b6-2b76-414e-9daa-7fac47bbec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.642230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc62b6-2b76-414e-9daa-7fac47bbec05 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.643988 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc62b6-2b76-414e-9daa-7fac47bbec05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:13.647456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc62b6-2b76-414e-9daa-7fac47bbec05 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.663772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1260/2513] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:13 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:48:13.669460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc62b6-2b76-414e-9daa-7fac47bbec05 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.676706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1254/2514] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:48:13 2021] PUT /identity/v3/projects/1b5b248e232740e0b2f4072492ec0b45/users/684779ffbf5a46cdbe7b4def7cb23ead/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:13.685518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc62b6-2b76-414e-9daa-7fac47bbec05 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.694646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9324c-21c2-4bdf-aea6-12500f87947b None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.695951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9324c-21c2-4bdf-aea6-12500f87947b None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.696854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9324c-21c2-4bdf-aea6-12500f87947b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.741440 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-1af9324c-21c2-4bdf-aea6-12500f87947b None None] MFA Rules not processed for user `684779ffbf5a46cdbe7b4def7cb23ead`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:13.743203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1af9324c-21c2-4bdf-aea6-12500f87947b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:13.772476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b1c2b-dc05-439a-89f9-6800434d829a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:13.773214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b1c2b-dc05-439a-89f9-6800434d829a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.773494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b1c2b-dc05-439a-89f9-6800434d829a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.773846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b1c2b-dc05-439a-89f9-6800434d829a admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.774595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b1c2b-dc05-439a-89f9-6800434d829a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:13.776248 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b1c2b-dc05-439a-89f9-6800434d829a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.787571 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1261/2515] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:13 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:13.792305 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b1c2b-dc05-439a-89f9-6800434d829a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.803227 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b1c2b-dc05-439a-89f9-6800434d829a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.810697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d06e97-ec2e-4d41-bd7e-133478fd80f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:13.811594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06e97-ec2e-4d41-bd7e-133478fd80f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.819700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06e97-ec2e-4d41-bd7e-133478fd80f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.819700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06e97-ec2e-4d41-bd7e-133478fd80f9 admin admin] PATH_INFO: `/v3/projects/5dd823e4656a4d49957c3941a0192cd6/users/d50dfdf7cc204433b4ddebd0366ae4f3/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.829526 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d06e97-ec2e-4d41-bd7e-133478fd80f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd823e4656a4d49957c3941a0192cd6, user_id=d50dfdf7cc204433b4ddebd0366ae4f3, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:13.830454 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1255/2516] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:13 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:13.832286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d06e97-ec2e-4d41-bd7e-133478fd80f9 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.842418 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9324c-21c2-4bdf-aea6-12500f87947b None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:13.843828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1af9324c-21c2-4bdf-aea6-12500f87947b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:13.936519 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1262/2517] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:48:13 2021] PUT /identity/v3/projects/5dd823e4656a4d49957c3941a0192cd6/users/d50dfdf7cc204433b4ddebd0366ae4f3/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:13.943321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558144f-22c5-41f1-b27b-06062e3ef9dc None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:13.943604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558144f-22c5-41f1-b27b-06062e3ef9dc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:13.944047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558144f-22c5-41f1-b27b-06062e3ef9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:13.952015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9324c-21c2-4bdf-aea6-12500f87947b None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:13.987328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d558144f-22c5-41f1-b27b-06062e3ef9dc None None] MFA Rules not processed for user `d50dfdf7cc204433b4ddebd0366ae4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:13.988759 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d558144f-22c5-41f1-b27b-06062e3ef9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:14.021448 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a4f21-d0d7-45c4-8c03-8759b86ba27e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f041d8d6b5949c48920b729511f3783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:14.022278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a4f21-d0d7-45c4-8c03-8759b86ba27e service glance] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:14.022676 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a4f21-d0d7-45c4-8c03-8759b86ba27e service glance] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:14.023130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a4f21-d0d7-45c4-8c03-8759b86ba27e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:14.083992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1263/2518] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:13 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:14.092106 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558144f-22c5-41f1-b27b-06062e3ef9dc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:14.093765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a4f21-d0d7-45c4-8c03-8759b86ba27e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:14.093965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d558144f-22c5-41f1-b27b-06062e3ef9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:14.095214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a4f21-d0d7-45c4-8c03-8759b86ba27e service glance] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:14.106231 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1256/2519] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:13 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:48:14.163568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558144f-22c5-41f1-b27b-06062e3ef9dc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:14.168523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d43f21-648a-47d4-a5b0-ca091ca389b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:14.169044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d43f21-648a-47d4-a5b0-ca091ca389b1 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:14.169363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d43f21-648a-47d4-a5b0-ca091ca389b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:14.169642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d43f21-648a-47d4-a5b0-ca091ca389b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:14.178680 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d43f21-648a-47d4-a5b0-ca091ca389b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:14.180783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d43f21-648a-47d4-a5b0-ca091ca389b1 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:14.190958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1264/2520] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:14 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:48:21.753451 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a4f21-d0d7-45c4-8c03-8759b86ba27e service glance] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:21.754946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-772a4f21-d0d7-45c4-8c03-8759b86ba27e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:21.811890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a4f21-d0d7-45c4-8c03-8759b86ba27e service glance] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:21.815533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee8593-f891-424a-8400-9d8667fde289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:21.821559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8593-f891-424a-8400-9d8667fde289 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:21.821559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8593-f891-424a-8400-9d8667fde289 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:21.821559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8593-f891-424a-8400-9d8667fde289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:21.821559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-9aee8593-f891-424a-8400-9d8667fde289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:21.885459 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee8593-f891-424a-8400-9d8667fde289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:21.886937 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee8593-f891-424a-8400-9d8667fde289 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:21.897118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1257/2521] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:21 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:48:27.159803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d43f21-648a-47d4-a5b0-ca091ca389b1 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:27.237856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d43f21-648a-47d4-a5b0-ca091ca389b1 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:27.247668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:27.248615 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:27.248905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:27.249170 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] PATH_INFO: `/v3/users/d50dfdf7cc204433b4ddebd0366ae4f3` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:27.250494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50dfdf7cc204433b4ddebd0366ae4f3)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:27.252497 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:27.490632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50dfdf7cc204433b4ddebd0366ae4f3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:27.495415 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50dfdf7cc204433b4ddebd0366ae4f3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:27.497770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50dfdf7cc204433b4ddebd0366ae4f3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:27.513444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50dfdf7cc204433b4ddebd0366ae4f3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:27.625952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50dfdf7cc204433b4ddebd0366ae4f3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:27.639394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1265/2522] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:48:27 2021] DELETE /identity/v3/users/d50dfdf7cc204433b4ddebd0366ae4f3 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:27.644338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c937-2453-4251-8076-b6dc349b1ec8 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:27.644912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c937-2453-4251-8076-b6dc349b1ec8 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:27.645153 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c937-2453-4251-8076-b6dc349b1ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:27.664828 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-a394c937-2453-4251-8076-b6dc349b1ec8 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:27.665420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a394c937-2453-4251-8076-b6dc349b1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:27.739054 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1258/2523] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:27.749243 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:27.750246 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:27.815415 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a0434-27b0-4f06-b5ee-05172768ca6f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:27.819432 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139998c-468e-4267-a7a4-268b4d545e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:27.820125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139998c-468e-4267-a7a4-268b4d545e2e service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:27.820888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139998c-468e-4267-a7a4-268b4d545e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:27.821281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139998c-468e-4267-a7a4-268b4d545e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:27.831278 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139998c-468e-4267-a7a4-268b4d545e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:27.832710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139998c-468e-4267-a7a4-268b4d545e2e service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:27.853795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1266/2524] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:28.476539 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c937-2453-4251-8076-b6dc349b1ec8 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:28.478103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a394c937-2453-4251-8076-b6dc349b1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:28.495203 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c937-2453-4251-8076-b6dc349b1ec8 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:28.501700 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:28.503024 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.503417 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.503797 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] PATH_INFO: `/v3/projects/5dd823e4656a4d49957c3941a0192cd6` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.506744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd823e4656a4d49957c3941a0192cd6)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:28.510359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:28.666920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd823e4656a4d49957c3941a0192cd6', 'request_id': 'req-19562c3c-e947-4067-b766-e959bff1af5c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.668598 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd823e4656a4d49957c3941a0192cd6', 'request_id': 'req-19562c3c-e947-4067-b766-e959bff1af5c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.674744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd823e4656a4d49957c3941a0192cd6', 'request_id': 'req-19562c3c-e947-4067-b766-e959bff1af5c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.759954 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] The token cache is being invalidate because project 5dd823e4656a4d49957c3941a0192cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:28.760595 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.762825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.766100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1259/2525] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:48:28 2021] DELETE /identity/v3/projects/5dd823e4656a4d49957c3941a0192cd6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:32.123523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564925e5-e4b7-4dec-b305-9970016720c2 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:32.124025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564925e5-e4b7-4dec-b305-9970016720c2 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:32.124122 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564925e5-e4b7-4dec-b305-9970016720c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:32.141471 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-564925e5-e4b7-4dec-b305-9970016720c2 None None] MFA Rules not processed for user `75cae7faa6a64b90aa5398adc4288503`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:32.142666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-564925e5-e4b7-4dec-b305-9970016720c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:32.206679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1267/2526] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:32 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:46.032213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.033678 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.095386 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19562c3c-e947-4067-b766-e959bff1af5c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.100182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.101102 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.101382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.101656 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] PATH_INFO: `/v3/users/684779ffbf5a46cdbe7b4def7cb23ead` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.103487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=684779ffbf5a46cdbe7b4def7cb23ead)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:46.105437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.279597 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684779ffbf5a46cdbe7b4def7cb23ead'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:46.291156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684779ffbf5a46cdbe7b4def7cb23ead'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:46.291808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684779ffbf5a46cdbe7b4def7cb23ead'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:46.299538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684779ffbf5a46cdbe7b4def7cb23ead'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:46.357689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684779ffbf5a46cdbe7b4def7cb23ead'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:46.364105 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1260/2527] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:48:46 2021] DELETE /identity/v3/users/684779ffbf5a46cdbe7b4def7cb23ead => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:46.369221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff2896-4320-4936-ac2c-5297eabd3b18 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.369697 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff2896-4320-4936-ac2c-5297eabd3b18 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.369823 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff2896-4320-4936-ac2c-5297eabd3b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.388652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b9ff2896-4320-4936-ac2c-5297eabd3b18 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:46.389859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b9ff2896-4320-4936-ac2c-5297eabd3b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.445831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1268/2528] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:46.455845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.457314 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.513246 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620341fc-de78-4f59-bb6f-fcfeb6d1fcc3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.516991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdde53-7547-40ef-b684-652f29c85578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.517631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdde53-7547-40ef-b684-652f29c85578 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.517908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdde53-7547-40ef-b684-652f29c85578 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.518179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdde53-7547-40ef-b684-652f29c85578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.527987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdde53-7547-40ef-b684-652f29c85578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:46.529456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdde53-7547-40ef-b684-652f29c85578 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.538940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1261/2529] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:46.974565 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff2896-4320-4936-ac2c-5297eabd3b18 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.975976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b9ff2896-4320-4936-ac2c-5297eabd3b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.990019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff2896-4320-4936-ac2c-5297eabd3b18 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.995489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.996413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.996863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.997019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] PATH_INFO: `/v3/projects/1b5b248e232740e0b2f4072492ec0b45` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.998349 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5b248e232740e0b2f4072492ec0b45)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.000451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.107313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5b248e232740e0b2f4072492ec0b45', 'request_id': 'req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.175642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5b248e232740e0b2f4072492ec0b45', 'request_id': 'req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.182100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5b248e232740e0b2f4072492ec0b45', 'request_id': 'req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.193459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] The token cache is being invalidate because project 1b5b248e232740e0b2f4072492ec0b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:47.193748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.194393 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a6e44a13-85f5-4d81-b20a-a4f6a572d0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.196022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1269/2530] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:48:46 2021] DELETE /identity/v3/projects/1b5b248e232740e0b2f4072492ec0b45 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:47.201788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73599049-8efe-4c83-adc4-1baf73ff3611 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.202312 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73599049-8efe-4c83-adc4-1baf73ff3611 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.202408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73599049-8efe-4c83-adc4-1baf73ff3611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.220985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-73599049-8efe-4c83-adc4-1baf73ff3611 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:47.222222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-73599049-8efe-4c83-adc4-1baf73ff3611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:47.291261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1262/2531] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:47.299801 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590c4f2-cd26-43e1-beea-56cf8e04ebad None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.300090 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590c4f2-cd26-43e1-beea-56cf8e04ebad None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.300383 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590c4f2-cd26-43e1-beea-56cf8e04ebad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.318550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2590c4f2-cd26-43e1-beea-56cf8e04ebad None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:47.319769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2590c4f2-cd26-43e1-beea-56cf8e04ebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:47.328382 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1270/2532] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:47.332547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73599049-8efe-4c83-adc4-1baf73ff3611 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.342603 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73599049-8efe-4c83-adc4-1baf73ff3611 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.347321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48119992-1e97-4c08-a114-0e8983c9055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.347989 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119992-1e97-4c08-a114-0e8983c9055c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.348273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119992-1e97-4c08-a114-0e8983c9055c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.348579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119992-1e97-4c08-a114-0e8983c9055c admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.350400 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48119992-1e97-4c08-a114-0e8983c9055c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:47.350400 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48119992-1e97-4c08-a114-0e8983c9055c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.351232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48119992-1e97-4c08-a114-0e8983c9055c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.364110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1263/2533] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:48:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:48:47.374703 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590c4f2-cd26-43e1-beea-56cf8e04ebad None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.384387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590c4f2-cd26-43e1-beea-56cf8e04ebad None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.389394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79449cc-068a-4cdb-b97e-5ee717268c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.390052 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79449cc-068a-4cdb-b97e-5ee717268c42 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.390334 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79449cc-068a-4cdb-b97e-5ee717268c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.390609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79449cc-068a-4cdb-b97e-5ee717268c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.391385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79449cc-068a-4cdb-b97e-5ee717268c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.393340 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79449cc-068a-4cdb-b97e-5ee717268c42 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.486114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1271/2534] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:48:47 2021] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:47.490292 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48119992-1e97-4c08-a114-0e8983c9055c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.502611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48119992-1e97-4c08-a114-0e8983c9055c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.562137 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7f638-7c83-4fc6-9fa1-41f5abc2fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.562816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f638-7c83-4fc6-9fa1-41f5abc2fc94 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.563097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f638-7c83-4fc6-9fa1-41f5abc2fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.563375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f638-7c83-4fc6-9fa1-41f5abc2fc94 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.564065 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7f638-7c83-4fc6-9fa1-41f5abc2fc94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.566002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7f638-7c83-4fc6-9fa1-41f5abc2fc94 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.702150 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1264/2535] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:48:47 2021] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:47.706406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79449cc-068a-4cdb-b97e-5ee717268c42 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.717792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79449cc-068a-4cdb-b97e-5ee717268c42 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.722522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c25f-c5a6-475d-b5a7-e6c33cedf0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.723166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c25f-c5a6-475d-b5a7-e6c33cedf0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.723447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c25f-c5a6-475d-b5a7-e6c33cedf0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.723723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c25f-c5a6-475d-b5a7-e6c33cedf0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.724490 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48c25f-c5a6-475d-b5a7-e6c33cedf0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.726092 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48c25f-c5a6-475d-b5a7-e6c33cedf0a1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.737139 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1272/2536] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:47.741443 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7f638-7c83-4fc6-9fa1-41f5abc2fc94 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.755634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7f638-7c83-4fc6-9fa1-41f5abc2fc94 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.761134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec768c48-880f-49e8-86c2-0e9c9ba97779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.761800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec768c48-880f-49e8-86c2-0e9c9ba97779 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.762074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec768c48-880f-49e8-86c2-0e9c9ba97779 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.762343 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec768c48-880f-49e8-86c2-0e9c9ba97779 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.763088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec768c48-880f-49e8-86c2-0e9c9ba97779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.764711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec768c48-880f-49e8-86c2-0e9c9ba97779 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.778867 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1265/2537] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:48:47 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:47.780902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c25f-c5a6-475d-b5a7-e6c33cedf0a1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.791753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c25f-c5a6-475d-b5a7-e6c33cedf0a1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.796622 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231be1-e38e-495d-9bb3-5e9a415139b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.797510 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231be1-e38e-495d-9bb3-5e9a415139b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.797793 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231be1-e38e-495d-9bb3-5e9a415139b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.798068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231be1-e38e-495d-9bb3-5e9a415139b4 admin admin] PATH_INFO: `/v3/projects/f46442e2b1484438a38576c4b3c4f2a0/users/aa1720f266754b48a88854fda40447ed/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.814932 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f231be1-e38e-495d-9bb3-5e9a415139b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46442e2b1484438a38576c4b3c4f2a0, user_id=aa1720f266754b48a88854fda40447ed, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.817889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f231be1-e38e-495d-9bb3-5e9a415139b4 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.911121 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1273/2538] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:48:47 2021] PUT /identity/v3/projects/f46442e2b1484438a38576c4b3c4f2a0/users/aa1720f266754b48a88854fda40447ed/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:47.922266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af822b5-f266-4547-a466-2678425de877 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.922655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af822b5-f266-4547-a466-2678425de877 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.923032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af822b5-f266-4547-a466-2678425de877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.950294 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-7af822b5-f266-4547-a466-2678425de877 None None] MFA Rules not processed for user `aa1720f266754b48a88854fda40447ed`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:47.951507 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7af822b5-f266-4547-a466-2678425de877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:48.015820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1266/2539] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:48:47 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:48.027513 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231be1-e38e-495d-9bb3-5e9a415139b4 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:48.029166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8f231be1-e38e-495d-9bb3-5e9a415139b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:48.084754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231be1-e38e-495d-9bb3-5e9a415139b4 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:48.089173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fddb33-6024-4c4b-aa66-8ef512244f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:48.089818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fddb33-6024-4c4b-aa66-8ef512244f90 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.090104 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fddb33-6024-4c4b-aa66-8ef512244f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.090380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fddb33-6024-4c4b-aa66-8ef512244f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.099002 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fddb33-6024-4c4b-aa66-8ef512244f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:48.100453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fddb33-6024-4c4b-aa66-8ef512244f90 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:48.110924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1274/2540] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:48:48 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:07.371486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af822b5-f266-4547-a466-2678425de877 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:07.373069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7af822b5-f266-4547-a466-2678425de877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:07.429111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af822b5-f266-4547-a466-2678425de877 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:07.433353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7ef3c-8dbf-442d-8ec9-8b82083e4a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:07.438359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7ef3c-8dbf-442d-8ec9-8b82083e4a3c service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:07.438359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7ef3c-8dbf-442d-8ec9-8b82083e4a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:07.438359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7ef3c-8dbf-442d-8ec9-8b82083e4a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:07.438359 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-77c7ef3c-8dbf-442d-8ec9-8b82083e4a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:07.509537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7ef3c-8dbf-442d-8ec9-8b82083e4a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:07.510973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7ef3c-8dbf-442d-8ec9-8b82083e4a3c service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:07.522125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1267/2541] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:49:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:16.551550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fddb33-6024-4c4b-aa66-8ef512244f90 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:16.553022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b0fddb33-6024-4c4b-aa66-8ef512244f90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:16.569266 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fddb33-6024-4c4b-aa66-8ef512244f90 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:16.575009 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d57d0c-9fdd-4bd6-8cbf-85e697df79e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:16.575655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d57d0c-9fdd-4bd6-8cbf-85e697df79e8 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:16.575949 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d57d0c-9fdd-4bd6-8cbf-85e697df79e8 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:16.576226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d57d0c-9fdd-4bd6-8cbf-85e697df79e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:16.578029 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f9d57d0c-9fdd-4bd6-8cbf-85e697df79e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:16.637435 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d57d0c-9fdd-4bd6-8cbf-85e697df79e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:16.639038 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d57d0c-9fdd-4bd6-8cbf-85e697df79e8 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:16.648144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1275/2542] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:49:16 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:30.372520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7ef3c-8dbf-442d-8ec9-8b82083e4a3c service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:30.444197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7ef3c-8dbf-442d-8ec9-8b82083e4a3c service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:30.452175 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:30.453197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:30.453487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:30.453769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] PATH_INFO: `/v3/users/aa1720f266754b48a88854fda40447ed` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:30.455230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1720f266754b48a88854fda40447ed)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:30.457250 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:30.674788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d57d0c-9fdd-4bd6-8cbf-85e697df79e8 service nova] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:30.685780 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d57d0c-9fdd-4bd6-8cbf-85e697df79e8 service nova] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:30.689567 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512bd4f-2cf7-434e-8d43-8e95e452664f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:30.690309 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512bd4f-2cf7-434e-8d43-8e95e452664f service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:30.690774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512bd4f-2cf7-434e-8d43-8e95e452664f service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:30.691051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512bd4f-2cf7-434e-8d43-8e95e452664f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:30.692937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9512bd4f-2cf7-434e-8d43-8e95e452664f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:30.704084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512bd4f-2cf7-434e-8d43-8e95e452664f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:30.705607 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512bd4f-2cf7-434e-8d43-8e95e452664f service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:30.714753 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1276/2543] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:49:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:49:30.761305 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1720f266754b48a88854fda40447ed'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.773809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1720f266754b48a88854fda40447ed'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.774550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1720f266754b48a88854fda40447ed'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.782804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1720f266754b48a88854fda40447ed'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.886092 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1720f266754b48a88854fda40447ed'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.892767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1268/2544] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:49:30 2021] DELETE /identity/v3/users/aa1720f266754b48a88854fda40447ed => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:30.897346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b130c6-fb55-41ab-ba61-7ec8356e776d None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:30.897646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b130c6-fb55-41ab-ba61-7ec8356e776d None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:30.897975 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b130c6-fb55-41ab-ba61-7ec8356e776d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:30.916511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-d2b130c6-fb55-41ab-ba61-7ec8356e776d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:30.917744 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d2b130c6-fb55-41ab-ba61-7ec8356e776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:30.984548 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1277/2545] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:49:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:30.999233 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:31.000922 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:31.069145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78aed5-7bf9-4061-a0a5-893fa48e2d98 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:31.072874 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947d779-6085-4368-8172-cfc963705b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:31.073557 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947d779-6085-4368-8172-cfc963705b5f service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:31.073824 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947d779-6085-4368-8172-cfc963705b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:31.074126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947d779-6085-4368-8172-cfc963705b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:31.085262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947d779-6085-4368-8172-cfc963705b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:31.087900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947d779-6085-4368-8172-cfc963705b5f service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:31.109860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1269/2546] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:49:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:31.659419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b130c6-fb55-41ab-ba61-7ec8356e776d None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:31.660685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d2b130c6-fb55-41ab-ba61-7ec8356e776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:31.672929 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b130c6-fb55-41ab-ba61-7ec8356e776d None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:31.688601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:31.689661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:31.690053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:31.690812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] PATH_INFO: `/v3/projects/f46442e2b1484438a38576c4b3c4f2a0` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:31.696992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46442e2b1484438a38576c4b3c4f2a0)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:31.696992 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:31.835472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46442e2b1484438a38576c4b3c4f2a0', 'request_id': 'req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:31.922332 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46442e2b1484438a38576c4b3c4f2a0', 'request_id': 'req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:31.928423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46442e2b1484438a38576c4b3c4f2a0', 'request_id': 'req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:31.939875 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] The token cache is being invalidate because project f46442e2b1484438a38576c4b3c4f2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:31.940175 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:31.940868 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:31.942594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1278/2547] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:49:31 2021] DELETE /identity/v3/projects/f46442e2b1484438a38576c4b3c4f2a0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:39.982410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947d779-6085-4368-8172-cfc963705b5f service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:39.984157 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4947d779-6085-4368-8172-cfc963705b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:39.997693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947d779-6085-4368-8172-cfc963705b5f service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.055107 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c29a3-873e-405f-9e63-af47f6c92a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.056258 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c29a3-873e-405f-9e63-af47f6c92a59 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.056574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c29a3-873e-405f-9e63-af47f6c92a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.056851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c29a3-873e-405f-9e63-af47f6c92a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.058730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-915c29a3-873e-405f-9e63-af47f6c92a59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:40.142154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c29a3-873e-405f-9e63-af47f6c92a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.144432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c29a3-873e-405f-9e63-af47f6c92a59 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.164729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1270/2548] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:49:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:49:47.763649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:47.765524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:47.785480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa64a-95f2-4100-8c54-2cc7fa357ba6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:47.798863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee485c-6fc7-400b-a374-40399fa26722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:47.799560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee485c-6fc7-400b-a374-40399fa26722 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:47.799843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee485c-6fc7-400b-a374-40399fa26722 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:47.800117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee485c-6fc7-400b-a374-40399fa26722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:47.802365 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e4ee485c-6fc7-400b-a374-40399fa26722 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:47.818390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee485c-6fc7-400b-a374-40399fa26722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:47.821199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee485c-6fc7-400b-a374-40399fa26722 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:47.839315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1279/2549] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:49:47 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:49.664503 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0bfdc-390e-4d30-a87f-de9cd91de994 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:49.665160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0bfdc-390e-4d30-a87f-de9cd91de994 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:49.665160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0bfdc-390e-4d30-a87f-de9cd91de994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:49.684394 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-32c0bfdc-390e-4d30-a87f-de9cd91de994 None None] MFA Rules not processed for user `541c688efdf8455c9a083ca11f2678be`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:49.685905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-32c0bfdc-390e-4d30-a87f-de9cd91de994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:49.771535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1271/2550] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:49:49 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:50.103313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee485c-6fc7-400b-a374-40399fa26722 service nova] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:50.104867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e4ee485c-6fc7-400b-a374-40399fa26722 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:50.116169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee485c-6fc7-400b-a374-40399fa26722 service nova] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:50.120403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb234616-dbca-4e50-837f-6924d58f60d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:50.121059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb234616-dbca-4e50-837f-6924d58f60d0 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:50.121341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb234616-dbca-4e50-837f-6924d58f60d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:50.121619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb234616-dbca-4e50-837f-6924d58f60d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:50.123429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-eb234616-dbca-4e50-837f-6924d58f60d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:50.135225 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb234616-dbca-4e50-837f-6924d58f60d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:50.137719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb234616-dbca-4e50-837f-6924d58f60d0 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:50.146634 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1280/2551] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:49:50 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:51.100213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce34b-f66d-478e-bcfd-18111eb2de4d None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.100827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce34b-f66d-478e-bcfd-18111eb2de4d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.100827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce34b-f66d-478e-bcfd-18111eb2de4d None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.102685 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1272/2552] 10.222.0.25 () {54 vars in 960 bytes} [Fri Aug 27 04:49:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:49:51.108892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e0c3-c670-42c2-9c12-969996e744f9 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.110144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e0c3-c670-42c2-9c12-969996e744f9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.110144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e0c3-c670-42c2-9c12-969996e744f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.162984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-f789e0c3-c670-42c2-9c12-969996e744f9 None None] MFA Rules not processed for user `3ef904ebfd2c4372b169ba7804278f19`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:51.164280 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f789e0c3-c670-42c2-9c12-969996e744f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.233941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1281/2553] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Aug 27 04:49:51 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:51.241672 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fce34b-f66d-478e-bcfd-18111eb2de4d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:51.255928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fce34b-f66d-478e-bcfd-18111eb2de4d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:51.262005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87a5de-b4b3-43d8-9d9c-58102762d511 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:51.262722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87a5de-b4b3-43d8-9d9c-58102762d511 service placement] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.263011 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87a5de-b4b3-43d8-9d9c-58102762d511 service placement] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.263291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87a5de-b4b3-43d8-9d9c-58102762d511 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.265156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-2e87a5de-b4b3-43d8-9d9c-58102762d511 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.277158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87a5de-b4b3-43d8-9d9c-58102762d511 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:51.278745 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87a5de-b4b3-43d8-9d9c-58102762d511 service placement] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:51.288984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1273/2554] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:49:51 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:53.057257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789e0c3-c670-42c2-9c12-969996e744f9 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:53.058808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f789e0c3-c670-42c2-9c12-969996e744f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:53.082692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789e0c3-c670-42c2-9c12-969996e744f9 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:53.099328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff050-789c-405f-b862-3d96630c18f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:53.100534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff050-789c-405f-b862-3d96630c18f3 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:53.107384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff050-789c-405f-b862-3d96630c18f3 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:53.128045 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff050-789c-405f-b862-3d96630c18f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:53.132402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-70dff050-789c-405f-b862-3d96630c18f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:53.177818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dff050-789c-405f-b862-3d96630c18f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:53.179494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dff050-789c-405f-b862-3d96630c18f3 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:53.213004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1282/2555] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:49:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:49:54.331582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e434-a566-44da-bda1-26d32fe82197 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:54.332055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e434-a566-44da-bda1-26d32fe82197 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:54.332154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e434-a566-44da-bda1-26d32fe82197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:54.350895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4225e434-a566-44da-bda1-26d32fe82197 None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:54.352831 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4225e434-a566-44da-bda1-26d32fe82197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:54.416878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1274/2556] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:49:54 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:54.461686 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff050-789c-405f-b862-3d96630c18f3 service nova] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:54.463377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-70dff050-789c-405f-b862-3d96630c18f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:54.537986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff050-789c-405f-b862-3d96630c18f3 service nova] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:54.543822 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39896e58-9bed-43c2-b132-69dbe3e00176 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:54.544537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39896e58-9bed-43c2-b132-69dbe3e00176 service swift] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:54.544835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39896e58-9bed-43c2-b132-69dbe3e00176 service swift] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:54.545099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39896e58-9bed-43c2-b132-69dbe3e00176 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:54.554081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39896e58-9bed-43c2-b132-69dbe3e00176 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:54.555813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39896e58-9bed-43c2-b132-69dbe3e00176 service swift] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:54.566399 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1283/2557] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:49:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:55.357961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e434-a566-44da-bda1-26d32fe82197 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:55.381226 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e434-a566-44da-bda1-26d32fe82197 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:55.395547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fb686-1c74-438c-a49e-cac250085078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:55.397072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fb686-1c74-438c-a49e-cac250085078 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:55.397536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fb686-1c74-438c-a49e-cac250085078 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:55.397984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fb686-1c74-438c-a49e-cac250085078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:55.401133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-875fb686-1c74-438c-a49e-cac250085078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:55.419694 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fb686-1c74-438c-a49e-cac250085078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:55.423569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fb686-1c74-438c-a49e-cac250085078 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:55.449774 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1275/2558] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:49:55 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:04.080310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dff326-1f54-44b5-9261-1e8a3db53d24 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:04.081803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dff326-1f54-44b5-9261-1e8a3db53d24 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:04.081803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dff326-1f54-44b5-9261-1e8a3db53d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:04.098870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-37dff326-1f54-44b5-9261-1e8a3db53d24 None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:04.100525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-37dff326-1f54-44b5-9261-1e8a3db53d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:04.110080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1284/2559] 10.222.0.25 () {58 vars in 968 bytes} [Fri Aug 27 04:50:04 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:04.131860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fb686-1c74-438c-a49e-cac250085078 service nova] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:04.147473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fb686-1c74-438c-a49e-cac250085078 service nova] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:04.153077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3cb08-bb78-492d-86aa-b50adad0a8a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:04.154513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3cb08-bb78-492d-86aa-b50adad0a8a4 service swift] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:04.154513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3cb08-bb78-492d-86aa-b50adad0a8a4 service swift] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:04.154941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3cb08-bb78-492d-86aa-b50adad0a8a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:04.164605 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3cb08-bb78-492d-86aa-b50adad0a8a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:04.166230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3cb08-bb78-492d-86aa-b50adad0a8a4 service swift] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:04.177043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1276/2560] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:50:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:50:16.198170 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dff326-1f54-44b5-9261-1e8a3db53d24 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:16.199728 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-37dff326-1f54-44b5-9261-1e8a3db53d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.267861 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dff326-1f54-44b5-9261-1e8a3db53d24 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:16.273099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:16.273965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.274242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.274511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] PATH_INFO: `/v3/users/2bf313c2f1894c7b97d50c9afa8666b3` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.275708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf313c2f1894c7b97d50c9afa8666b3)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:16.277665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:16.458656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf313c2f1894c7b97d50c9afa8666b3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.459360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf313c2f1894c7b97d50c9afa8666b3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.462224 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf313c2f1894c7b97d50c9afa8666b3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.488334 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf313c2f1894c7b97d50c9afa8666b3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.571906 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf313c2f1894c7b97d50c9afa8666b3'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.595991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1285/2561] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:50:16 2021] DELETE /identity/v3/users/2bf313c2f1894c7b97d50c9afa8666b3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:16.651256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7fab-5cd5-4fe7-88cd-1ffadb07876c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.651754 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7fab-5cd5-4fe7-88cd-1ffadb07876c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.651838 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7fab-5cd5-4fe7-88cd-1ffadb07876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.670409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f7ea7fab-5cd5-4fe7-88cd-1ffadb07876c None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:16.671622 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f7ea7fab-5cd5-4fe7-88cd-1ffadb07876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.736834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1277/2562] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 04:50:16 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:16.751836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:16.753269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.824504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76e64c-a651-4ec3-9286-3007db1df99a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:16.829336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea7fab-5cd5-4fe7-88cd-1ffadb07876c None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:16.830293 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe78a-9fe3-41d5-bc81-32865cdd57c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:16.830705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f7ea7fab-5cd5-4fe7-88cd-1ffadb07876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.830959 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe78a-9fe3-41d5-bc81-32865cdd57c8 service swift] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.831244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe78a-9fe3-41d5-bc81-32865cdd57c8 service swift] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.831520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe78a-9fe3-41d5-bc81-32865cdd57c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.840829 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe78a-9fe3-41d5-bc81-32865cdd57c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:16.842465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe78a-9fe3-41d5-bc81-32865cdd57c8 service swift] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:16.854179 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1286/2563] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:50:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:50:16.910056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea7fab-5cd5-4fe7-88cd-1ffadb07876c None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:16.915317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:16.916341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.916657 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.916937 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] PATH_INFO: `/v3/projects/55642c30419042daa27ecdcf76f4e6a5` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.918176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55642c30419042daa27ecdcf76f4e6a5)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:16.920178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:17.061600 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55642c30419042daa27ecdcf76f4e6a5', 'request_id': 'req-c7fd85e0-e706-41b4-a701-59950702ff20'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.072664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55642c30419042daa27ecdcf76f4e6a5', 'request_id': 'req-c7fd85e0-e706-41b4-a701-59950702ff20'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.086693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55642c30419042daa27ecdcf76f4e6a5', 'request_id': 'req-c7fd85e0-e706-41b4-a701-59950702ff20'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.175794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] The token cache is being invalidate because project 55642c30419042daa27ecdcf76f4e6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:17.176013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.176732 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.178604 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1278/2564] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:50:16 2021] DELETE /identity/v3/projects/55642c30419042daa27ecdcf76f4e6a5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:50:17.183597 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe78a-9fe3-41d5-bc81-32865cdd57c8 service swift] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:17.195812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe78a-9fe3-41d5-bc81-32865cdd57c8 service swift] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:17.305191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:17.306824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:17.307258 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:17.307924 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] PATH_INFO: `/v3/users/e602e99570364be3a933fca9ce24bcba` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:17.309437 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e602e99570364be3a933fca9ce24bcba)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:17.311551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:17.519473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e602e99570364be3a933fca9ce24bcba'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.520156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e602e99570364be3a933fca9ce24bcba'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.520806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e602e99570364be3a933fca9ce24bcba'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.542766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e602e99570364be3a933fca9ce24bcba'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.615009 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-13eb5e36-a40e-4bb7-a69b-2902c5e7aa8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e602e99570364be3a933fca9ce24bcba'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.639867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1287/2565] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:50:17 2021] DELETE /identity/v3/users/e602e99570364be3a933fca9ce24bcba => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:17.965273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:17.967296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:17.981716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd85e0-e706-41b4-a701-59950702ff20 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:18.058970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:18.059753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:18.060042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:18.060324 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] PATH_INFO: `/v3/projects/d6f2c8ffb4b14ba68accea005580e1f0` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:18.061581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f2c8ffb4b14ba68accea005580e1f0)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:18.063616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:18.159380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f2c8ffb4b14ba68accea005580e1f0', 'request_id': 'req-60ba664c-b63e-438a-a648-e80897790a55'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.166461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f2c8ffb4b14ba68accea005580e1f0', 'request_id': 'req-60ba664c-b63e-438a-a648-e80897790a55'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.171823 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f2c8ffb4b14ba68accea005580e1f0', 'request_id': 'req-60ba664c-b63e-438a-a648-e80897790a55'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.270480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] The token cache is being invalidate because project d6f2c8ffb4b14ba68accea005580e1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:18.270806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.271475 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.273830 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1279/2566] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:50:17 2021] DELETE /identity/v3/projects/d6f2c8ffb4b14ba68accea005580e1f0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:34.997413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819292e-2e2a-480e-a3d9-c9c4f4c34169 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:34.997908 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819292e-2e2a-480e-a3d9-c9c4f4c34169 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:34.998015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819292e-2e2a-480e-a3d9-c9c4f4c34169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:35.015147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2819292e-2e2a-480e-a3d9-c9c4f4c34169 None None] MFA Rules not processed for user `36d3a6eb24b04e14a42d771c9c768ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:35.016397 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2819292e-2e2a-480e-a3d9-c9c4f4c34169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:35.070835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1288/2567] 10.222.0.25 () {58 vars in 968 bytes} [Fri Aug 27 04:50:34 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:50:35.085951 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:35.089087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:35.156572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba664c-b63e-438a-a648-e80897790a55 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:35.161647 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7e6e1-2e28-40d6-9205-4d06ee1ad5f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23aad5d62b84cd7a4da788500148f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:35.162301 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e6e1-2e28-40d6-9205-4d06ee1ad5f5 service swift] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:35.162590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e6e1-2e28-40d6-9205-4d06ee1ad5f5 service swift] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:35.162878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e6e1-2e28-40d6-9205-4d06ee1ad5f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:35.171206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7e6e1-2e28-40d6-9205-4d06ee1ad5f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:35.172904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7e6e1-2e28-40d6-9205-4d06ee1ad5f5 service swift] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:35.180959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1280/2568] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 04:50:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:17.916180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819292e-2e2a-480e-a3d9-c9c4f4c34169 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:17.918772 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2819292e-2e2a-480e-a3d9-c9c4f4c34169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:17.979247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819292e-2e2a-480e-a3d9-c9c4f4c34169 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:17.983156 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ad12e-7ffe-4f85-8386-031aa944acf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:17.988463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ad12e-7ffe-4f85-8386-031aa944acf9 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:17.988463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ad12e-7ffe-4f85-8386-031aa944acf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:17.988463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ad12e-7ffe-4f85-8386-031aa944acf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:17.989731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5a1ad12e-7ffe-4f85-8386-031aa944acf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:18.051459 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ad12e-7ffe-4f85-8386-031aa944acf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:18.052964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ad12e-7ffe-4f85-8386-031aa944acf9 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:18.062742 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1289/2569] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:19.463788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac471eb6-91ed-4a2e-a0bc-59ef4b5411b4 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:19.464946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac471eb6-91ed-4a2e-a0bc-59ef4b5411b4 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:19.464946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac471eb6-91ed-4a2e-a0bc-59ef4b5411b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:19.483409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ac471eb6-91ed-4a2e-a0bc-59ef4b5411b4 None None] MFA Rules not processed for user `ffd9f61944414b4f886413ad331d4378`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:19.484708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ac471eb6-91ed-4a2e-a0bc-59ef4b5411b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:19.541385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1281/2570] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:19 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:22.023945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ad12e-7ffe-4f85-8386-031aa944acf9 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.025414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5a1ad12e-7ffe-4f85-8386-031aa944acf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:22.038689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ad12e-7ffe-4f85-8386-031aa944acf9 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.043248 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.044105 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.044423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.044704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] PATH_INFO: `/v3/users/75cae7faa6a64b90aa5398adc4288503` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.045875 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cae7faa6a64b90aa5398adc4288503)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.047799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:22.225111 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cae7faa6a64b90aa5398adc4288503'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:22.225865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cae7faa6a64b90aa5398adc4288503'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:22.226594 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cae7faa6a64b90aa5398adc4288503'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:22.238584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cae7faa6a64b90aa5398adc4288503'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:22.297828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-98f60548-bc45-4360-98e5-b086ea5cfb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cae7faa6a64b90aa5398adc4288503'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:22.311195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1290/2571] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:51:22 2021] DELETE /identity/v3/users/75cae7faa6a64b90aa5398adc4288503 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:22.565388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac471eb6-91ed-4a2e-a0bc-59ef4b5411b4 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.577232 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac471eb6-91ed-4a2e-a0bc-59ef4b5411b4 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.639697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.640593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.640871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.641142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] PATH_INFO: `/v3/projects/2252ab66f4f64fa5a5d8fcb7ace33509` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.642346 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2252ab66f4f64fa5a5d8fcb7ace33509)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.644332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:22.759920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2252ab66f4f64fa5a5d8fcb7ace33509', 'request_id': 'req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:22.766655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2252ab66f4f64fa5a5d8fcb7ace33509', 'request_id': 'req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:22.774716 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2252ab66f4f64fa5a5d8fcb7ace33509', 'request_id': 'req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:22.857528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] The token cache is being invalidate because project 2252ab66f4f64fa5a5d8fcb7ace33509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:22.857820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:22.858475 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a5c1b0f1-1d73-40b4-8f5b-e2f9ed1dc29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:22.860011 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1282/2572] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:51:22 2021] DELETE /identity/v3/projects/2252ab66f4f64fa5a5d8fcb7ace33509 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:22.865833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31e070-88ca-4baa-943a-93f2e542d408 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.866119 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31e070-88ca-4baa-943a-93f2e542d408 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.866394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31e070-88ca-4baa-943a-93f2e542d408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.884882 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-6a31e070-88ca-4baa-943a-93f2e542d408 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:22.886081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6a31e070-88ca-4baa-943a-93f2e542d408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:22.947050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1291/2573] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:22.955070 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa728-2761-40c4-be44-30e6cef11306 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.961219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa728-2761-40c4-be44-30e6cef11306 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.961219 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa728-2761-40c4-be44-30e6cef11306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.974420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-27caa728-2761-40c4-be44-30e6cef11306 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:22.975625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-27caa728-2761-40c4-be44-30e6cef11306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:22.984112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1283/2574] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:22.988593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31e070-88ca-4baa-943a-93f2e542d408 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.998792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31e070-88ca-4baa-943a-93f2e542d408 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.003853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899b643-279d-4fc9-9d70-fc9c45df552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.004538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899b643-279d-4fc9-9d70-fc9c45df552e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.004826 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899b643-279d-4fc9-9d70-fc9c45df552e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.005107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899b643-279d-4fc9-9d70-fc9c45df552e admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.005870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899b643-279d-4fc9-9d70-fc9c45df552e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:23.006176 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899b643-279d-4fc9-9d70-fc9c45df552e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.007803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899b643-279d-4fc9-9d70-fc9c45df552e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.019032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1292/2575] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:51:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:23.023579 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caa728-2761-40c4-be44-30e6cef11306 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.033919 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caa728-2761-40c4-be44-30e6cef11306 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.039217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8a393-bca1-4b50-9ecc-aba5b1296944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.039926 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8a393-bca1-4b50-9ecc-aba5b1296944 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.040211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8a393-bca1-4b50-9ecc-aba5b1296944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.040523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8a393-bca1-4b50-9ecc-aba5b1296944 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.041208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8a393-bca1-4b50-9ecc-aba5b1296944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.043120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8a393-bca1-4b50-9ecc-aba5b1296944 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.150328 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1284/2576] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:51:23 2021] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:23.151509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899b643-279d-4fc9-9d70-fc9c45df552e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.174563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899b643-279d-4fc9-9d70-fc9c45df552e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.229739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428e5f3-c79e-4bf5-a11b-d90d3937753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.230423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428e5f3-c79e-4bf5-a11b-d90d3937753c admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.230705 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428e5f3-c79e-4bf5-a11b-d90d3937753c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.230985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428e5f3-c79e-4bf5-a11b-d90d3937753c admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.231694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428e5f3-c79e-4bf5-a11b-d90d3937753c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.233687 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428e5f3-c79e-4bf5-a11b-d90d3937753c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.331270 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1293/2577] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:51:23 2021] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:51:23.335990 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8a393-bca1-4b50-9ecc-aba5b1296944 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.346559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8a393-bca1-4b50-9ecc-aba5b1296944 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.351769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b668ec-eb24-4bbb-a5c1-b6355076231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.352467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b668ec-eb24-4bbb-a5c1-b6355076231c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.352753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b668ec-eb24-4bbb-a5c1-b6355076231c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.353031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b668ec-eb24-4bbb-a5c1-b6355076231c admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.353873 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b668ec-eb24-4bbb-a5c1-b6355076231c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.355479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b668ec-eb24-4bbb-a5c1-b6355076231c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.368429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1285/2578] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:51:23.369679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428e5f3-c79e-4bf5-a11b-d90d3937753c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.380022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428e5f3-c79e-4bf5-a11b-d90d3937753c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.384767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332b955-ea63-421f-98de-d21660466e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.386091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332b955-ea63-421f-98de-d21660466e63 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.386091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332b955-ea63-421f-98de-d21660466e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.386091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332b955-ea63-421f-98de-d21660466e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.386807 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332b955-ea63-421f-98de-d21660466e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.388444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332b955-ea63-421f-98de-d21660466e63 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.399526 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1294/2579] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:51:23.408645 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b668ec-eb24-4bbb-a5c1-b6355076231c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.419381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b668ec-eb24-4bbb-a5c1-b6355076231c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.424038 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372894e-49c0-4589-974e-2f5601f9aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.424982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372894e-49c0-4589-974e-2f5601f9aca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.425238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372894e-49c0-4589-974e-2f5601f9aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.425513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372894e-49c0-4589-974e-2f5601f9aca0 admin admin] PATH_INFO: `/v3/projects/393a0d4a03164ffca5863ee9158d4904/users/f0d08812d54c44ee921cf3f1c7ad68d4/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.440662 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372894e-49c0-4589-974e-2f5601f9aca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393a0d4a03164ffca5863ee9158d4904, user_id=f0d08812d54c44ee921cf3f1c7ad68d4, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.443343 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372894e-49c0-4589-974e-2f5601f9aca0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.566884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1286/2580] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:51:23 2021] PUT /identity/v3/projects/393a0d4a03164ffca5863ee9158d4904/users/f0d08812d54c44ee921cf3f1c7ad68d4/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:23.578883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7d9e-66f3-4ad5-a693-010a189dc39e None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.579199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7d9e-66f3-4ad5-a693-010a189dc39e None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.579478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7d9e-66f3-4ad5-a693-010a189dc39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.607303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-7f5c7d9e-66f3-4ad5-a693-010a189dc39e None None] MFA Rules not processed for user `f0d08812d54c44ee921cf3f1c7ad68d4`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:23.608478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-7f5c7d9e-66f3-4ad5-a693-010a189dc39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:23.675185 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1295/2581] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:23 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:23.679635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372894e-49c0-4589-974e-2f5601f9aca0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.752748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372894e-49c0-4589-974e-2f5601f9aca0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.758697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200c57c-1b2a-4f9a-9e91-c4575e6fd687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.759385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200c57c-1b2a-4f9a-9e91-c4575e6fd687 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.759673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200c57c-1b2a-4f9a-9e91-c4575e6fd687 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.759953 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200c57c-1b2a-4f9a-9e91-c4575e6fd687 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.760868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200c57c-1b2a-4f9a-9e91-c4575e6fd687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.763336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200c57c-1b2a-4f9a-9e91-c4575e6fd687 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.848251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1287/2582] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:51:23 2021] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:23.852489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7d9e-66f3-4ad5-a693-010a189dc39e None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.864554 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7d9e-66f3-4ad5-a693-010a189dc39e None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.923022 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed459731-7d24-456f-9553-c65fa516f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.923735 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed459731-7d24-456f-9553-c65fa516f493 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.924013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed459731-7d24-456f-9553-c65fa516f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.924288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed459731-7d24-456f-9553-c65fa516f493 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.925015 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed459731-7d24-456f-9553-c65fa516f493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.926941 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed459731-7d24-456f-9553-c65fa516f493 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.008476 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1296/2583] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:51:23 2021] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:51:24.012332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200c57c-1b2a-4f9a-9e91-c4575e6fd687 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.026869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200c57c-1b2a-4f9a-9e91-c4575e6fd687 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.036324 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0971fb3-9073-48bf-91b5-4a8f3ea71efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.037321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0971fb3-9073-48bf-91b5-4a8f3ea71efb admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.037747 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0971fb3-9073-48bf-91b5-4a8f3ea71efb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.038427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0971fb3-9073-48bf-91b5-4a8f3ea71efb admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.039299 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0971fb3-9073-48bf-91b5-4a8f3ea71efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.041126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0971fb3-9073-48bf-91b5-4a8f3ea71efb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.054848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1288/2584] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:24 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:51:24.059095 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed459731-7d24-456f-9553-c65fa516f493 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.072840 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed459731-7d24-456f-9553-c65fa516f493 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.082336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e186d70-f19f-43dc-b668-4302f2e9c5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.083607 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e186d70-f19f-43dc-b668-4302f2e9c5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.084024 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e186d70-f19f-43dc-b668-4302f2e9c5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.084533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e186d70-f19f-43dc-b668-4302f2e9c5ad admin admin] PATH_INFO: `/v3/projects/7275851fa6df4285ba641cc90aed190d/users/ddc49ddd626948fe93bf4d9877d7ae9e/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.102778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e186d70-f19f-43dc-b668-4302f2e9c5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7275851fa6df4285ba641cc90aed190d, user_id=ddc49ddd626948fe93bf4d9877d7ae9e, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.107795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e186d70-f19f-43dc-b668-4302f2e9c5ad admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.169116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1297/2585] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:51:24 2021] PUT /identity/v3/projects/7275851fa6df4285ba641cc90aed190d/users/ddc49ddd626948fe93bf4d9877d7ae9e/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:51:24.173367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0971fb3-9073-48bf-91b5-4a8f3ea71efb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.184253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0971fb3-9073-48bf-91b5-4a8f3ea71efb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.243033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aedfa7-62dc-4053-abfc-05b5fc455dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.243033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aedfa7-62dc-4053-abfc-05b5fc455dae admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.243384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aedfa7-62dc-4053-abfc-05b5fc455dae admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.243525 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aedfa7-62dc-4053-abfc-05b5fc455dae admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.244258 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aedfa7-62dc-4053-abfc-05b5fc455dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.245902 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aedfa7-62dc-4053-abfc-05b5fc455dae admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.255837 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1289/2586] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:24 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:24.260164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e186d70-f19f-43dc-b668-4302f2e9c5ad admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.270685 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e186d70-f19f-43dc-b668-4302f2e9c5ad admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.276395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd34541-9b57-4082-94bc-0d763ea1c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.277288 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd34541-9b57-4082-94bc-0d763ea1c1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.278034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd34541-9b57-4082-94bc-0d763ea1c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.278034 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd34541-9b57-4082-94bc-0d763ea1c1eb admin admin] PATH_INFO: `/v3/projects/7275851fa6df4285ba641cc90aed190d/users/ddc49ddd626948fe93bf4d9877d7ae9e/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.279824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd34541-9b57-4082-94bc-0d763ea1c1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7275851fa6df4285ba641cc90aed190d, user_id=ddc49ddd626948fe93bf4d9877d7ae9e, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.282589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd34541-9b57-4082-94bc-0d763ea1c1eb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.294286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1298/2587] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:51:24 2021] PUT /identity/v3/projects/7275851fa6df4285ba641cc90aed190d/users/ddc49ddd626948fe93bf4d9877d7ae9e/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:24.305144 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cbc1f-cd64-45df-ad22-c835548497af None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.305573 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cbc1f-cd64-45df-ad22-c835548497af None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.306111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cbc1f-cd64-45df-ad22-c835548497af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.332749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-2e7cbc1f-cd64-45df-ad22-c835548497af None None] MFA Rules not processed for user `ddc49ddd626948fe93bf4d9877d7ae9e`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:24.338484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-2e7cbc1f-cd64-45df-ad22-c835548497af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:24.401546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1290/2588] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:24 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:24.411385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd34541-9b57-4082-94bc-0d763ea1c1eb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.413081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1dd34541-9b57-4082-94bc-0d763ea1c1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:24.470877 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd34541-9b57-4082-94bc-0d763ea1c1eb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.474525 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b82634-7ca9-450c-ad87-26b239287986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.475166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b82634-7ca9-450c-ad87-26b239287986 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.475447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b82634-7ca9-450c-ad87-26b239287986 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.475719 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b82634-7ca9-450c-ad87-26b239287986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.485407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b82634-7ca9-450c-ad87-26b239287986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.486863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b82634-7ca9-450c-ad87-26b239287986 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.497707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1299/2589] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:24 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:27.239153 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cbc1f-cd64-45df-ad22-c835548497af None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:27.301073 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cbc1f-cd64-45df-ad22-c835548497af None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:27.306254 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:27.307133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:27.307487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:27.307742 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] PATH_INFO: `/v3/users/f0d08812d54c44ee921cf3f1c7ad68d4` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:27.308995 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d08812d54c44ee921cf3f1c7ad68d4)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:27.310916 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:27.510141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d08812d54c44ee921cf3f1c7ad68d4'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.521236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d08812d54c44ee921cf3f1c7ad68d4'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.521896 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d08812d54c44ee921cf3f1c7ad68d4'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.528585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d08812d54c44ee921cf3f1c7ad68d4'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.634591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d08812d54c44ee921cf3f1c7ad68d4'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.641356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1291/2590] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:51:27 2021] DELETE /identity/v3/users/f0d08812d54c44ee921cf3f1c7ad68d4 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:27.645873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec7675-ed80-4940-9d54-18d93a3e27ca None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:27.649306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec7675-ed80-4940-9d54-18d93a3e27ca None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:27.649306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec7675-ed80-4940-9d54-18d93a3e27ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:27.666816 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-cfec7675-ed80-4940-9d54-18d93a3e27ca None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:27.668063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-cfec7675-ed80-4940-9d54-18d93a3e27ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:27.729242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1300/2591] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:51:27.739321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:27.740794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:27.797197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab16a4-2671-4d15-97d7-fbc413b19618 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:27.800910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab6c33-2923-4423-be84-3f449477b374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:27.801547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab6c33-2923-4423-be84-3f449477b374 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:27.801825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab6c33-2923-4423-be84-3f449477b374 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:27.802097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab6c33-2923-4423-be84-3f449477b374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:27.810970 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab6c33-2923-4423-be84-3f449477b374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:27.812434 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab6c33-2923-4423-be84-3f449477b374 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:27.822050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1292/2592] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:28.247180 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec7675-ed80-4940-9d54-18d93a3e27ca None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:28.249030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-cfec7675-ed80-4940-9d54-18d93a3e27ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:28.262665 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec7675-ed80-4940-9d54-18d93a3e27ca None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:28.267766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:28.271940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:28.271940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:28.271940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] PATH_INFO: `/v3/projects/393a0d4a03164ffca5863ee9158d4904` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:28.271940 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393a0d4a03164ffca5863ee9158d4904)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:28.273733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:28.387263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393a0d4a03164ffca5863ee9158d4904', 'request_id': 'req-5e6df057-f773-49e0-915d-cae384d43f74'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.451587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393a0d4a03164ffca5863ee9158d4904', 'request_id': 'req-5e6df057-f773-49e0-915d-cae384d43f74'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.459173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393a0d4a03164ffca5863ee9158d4904', 'request_id': 'req-5e6df057-f773-49e0-915d-cae384d43f74'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.470212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] The token cache is being invalidate because project 393a0d4a03164ffca5863ee9158d4904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:28.470492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.471132 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.472739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1301/2593] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:51:28 2021] DELETE /identity/v3/projects/393a0d4a03164ffca5863ee9158d4904 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:28.477022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab6c33-2923-4423-be84-3f449477b374 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:28.486503 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab6c33-2923-4423-be84-3f449477b374 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:28.540908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:28.541807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:28.550806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:28.550806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] PATH_INFO: `/v3/users/ddc49ddd626948fe93bf4d9877d7ae9e` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:28.550806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc49ddd626948fe93bf4d9877d7ae9e)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:28.550806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:28.678303 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc49ddd626948fe93bf4d9877d7ae9e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.694751 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc49ddd626948fe93bf4d9877d7ae9e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.695462 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc49ddd626948fe93bf4d9877d7ae9e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.702186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc49ddd626948fe93bf4d9877d7ae9e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.748329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9a444be6-eb19-44a0-9a2b-c5a408c4ffba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc49ddd626948fe93bf4d9877d7ae9e'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.754427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1293/2594] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:51:28 2021] DELETE /identity/v3/users/ddc49ddd626948fe93bf4d9877d7ae9e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:29.138843 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.140295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:29.155544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6df057-f773-49e0-915d-cae384d43f74 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.212070 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.212876 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.213160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.213455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] PATH_INFO: `/v3/projects/7275851fa6df4285ba641cc90aed190d` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.214605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7275851fa6df4285ba641cc90aed190d)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.216536 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.319563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7275851fa6df4285ba641cc90aed190d', 'request_id': 'req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.406292 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7275851fa6df4285ba641cc90aed190d', 'request_id': 'req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.411712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7275851fa6df4285ba641cc90aed190d', 'request_id': 'req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.423552 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] The token cache is being invalidate because project 7275851fa6df4285ba641cc90aed190d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:29.423847 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.424556 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-7aefe2d5-6f8e-4292-adb2-8d522788f6ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.426108 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1302/2595] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:51:29 2021] DELETE /identity/v3/projects/7275851fa6df4285ba641cc90aed190d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:29.432138 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206461-b40f-4016-8529-8d82972dac47 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.432526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206461-b40f-4016-8529-8d82972dac47 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.432898 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206461-b40f-4016-8529-8d82972dac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.451536 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-23206461-b40f-4016-8529-8d82972dac47 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:29.452769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-23206461-b40f-4016-8529-8d82972dac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:29.511409 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1294/2596] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:29.519448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c211bd-b1e3-4eae-abea-571d394d9277 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.519833 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c211bd-b1e3-4eae-abea-571d394d9277 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.520218 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c211bd-b1e3-4eae-abea-571d394d9277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.538928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-24c211bd-b1e3-4eae-abea-571d394d9277 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:29.540141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-24c211bd-b1e3-4eae-abea-571d394d9277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:29.548281 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1303/2597] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:29.552584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23206461-b40f-4016-8529-8d82972dac47 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.562208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23206461-b40f-4016-8529-8d82972dac47 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.566804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46162a4-0551-4d5f-8ac5-0d560b569f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.567467 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46162a4-0551-4d5f-8ac5-0d560b569f3d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.567748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46162a4-0551-4d5f-8ac5-0d560b569f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.568023 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46162a4-0551-4d5f-8ac5-0d560b569f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.568785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46162a4-0551-4d5f-8ac5-0d560b569f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:29.569091 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46162a4-0551-4d5f-8ac5-0d560b569f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.571242 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46162a4-0551-4d5f-8ac5-0d560b569f3d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.582761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1295/2598] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:51:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:29.587821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c211bd-b1e3-4eae-abea-571d394d9277 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.597082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c211bd-b1e3-4eae-abea-571d394d9277 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.601762 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063c05-f380-41ec-8f68-e848df5141fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.602423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063c05-f380-41ec-8f68-e848df5141fc admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.602692 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063c05-f380-41ec-8f68-e848df5141fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.602973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063c05-f380-41ec-8f68-e848df5141fc admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.603660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7063c05-f380-41ec-8f68-e848df5141fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.605623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7063c05-f380-41ec-8f68-e848df5141fc admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.700125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1304/2599] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:51:29 2021] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:29.703668 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46162a4-0551-4d5f-8ac5-0d560b569f3d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.714133 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46162a4-0551-4d5f-8ac5-0d560b569f3d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.770981 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b820d7-c9ab-4fb3-8cd8-fd2462a112b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.771734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b820d7-c9ab-4fb3-8cd8-fd2462a112b1 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.771938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b820d7-c9ab-4fb3-8cd8-fd2462a112b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.772239 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b820d7-c9ab-4fb3-8cd8-fd2462a112b1 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.773627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b820d7-c9ab-4fb3-8cd8-fd2462a112b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.775593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b820d7-c9ab-4fb3-8cd8-fd2462a112b1 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.840366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1296/2600] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:51:29 2021] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:29.844585 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063c05-f380-41ec-8f68-e848df5141fc admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.855627 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063c05-f380-41ec-8f68-e848df5141fc admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.860827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660d77b-9a57-4c24-a180-7ffaf64b249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.861761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660d77b-9a57-4c24-a180-7ffaf64b249b admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.862353 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660d77b-9a57-4c24-a180-7ffaf64b249b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.862820 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660d77b-9a57-4c24-a180-7ffaf64b249b admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.863873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660d77b-9a57-4c24-a180-7ffaf64b249b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.865765 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660d77b-9a57-4c24-a180-7ffaf64b249b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.878528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1305/2601] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:29 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:29.883228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b820d7-c9ab-4fb3-8cd8-fd2462a112b1 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.893804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b820d7-c9ab-4fb3-8cd8-fd2462a112b1 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.898755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad48bc-7881-4da4-b637-06c5b362505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.899445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad48bc-7881-4da4-b637-06c5b362505f admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.899731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad48bc-7881-4da4-b637-06c5b362505f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.900010 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad48bc-7881-4da4-b637-06c5b362505f admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.900812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad48bc-7881-4da4-b637-06c5b362505f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.902460 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad48bc-7881-4da4-b637-06c5b362505f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.913887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1297/2602] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:51:29.917628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660d77b-9a57-4c24-a180-7ffaf64b249b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.927884 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660d77b-9a57-4c24-a180-7ffaf64b249b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.933267 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3698e0c-9b30-4d90-a3cf-4ba9a138bb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.934356 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3698e0c-9b30-4d90-a3cf-4ba9a138bb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.934494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3698e0c-9b30-4d90-a3cf-4ba9a138bb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.934743 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3698e0c-9b30-4d90-a3cf-4ba9a138bb9e admin admin] PATH_INFO: `/v3/projects/632984978d504dabba6a615312a7f21d/users/cd843a7bd74642d6999b50829bb2f75c/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.949816 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3698e0c-9b30-4d90-a3cf-4ba9a138bb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=632984978d504dabba6a615312a7f21d, user_id=cd843a7bd74642d6999b50829bb2f75c, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.952789 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3698e0c-9b30-4d90-a3cf-4ba9a138bb9e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.029912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1306/2603] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:51:29 2021] PUT /identity/v3/projects/632984978d504dabba6a615312a7f21d/users/cd843a7bd74642d6999b50829bb2f75c/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:30.041868 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3679-51e1-4498-af5a-c7f6449e89b7 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.042158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3679-51e1-4498-af5a-c7f6449e89b7 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.042453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3679-51e1-4498-af5a-c7f6449e89b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.070500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-5b8b3679-51e1-4498-af5a-c7f6449e89b7 None None] MFA Rules not processed for user `cd843a7bd74642d6999b50829bb2f75c`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:30.071834 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5b8b3679-51e1-4498-af5a-c7f6449e89b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.135631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1298/2604] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:30 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:30.140054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3698e0c-9b30-4d90-a3cf-4ba9a138bb9e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.198804 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3698e0c-9b30-4d90-a3cf-4ba9a138bb9e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.203465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c061692-61c8-4e6f-a6b1-b97bf280dd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.204118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c061692-61c8-4e6f-a6b1-b97bf280dd52 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.204426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c061692-61c8-4e6f-a6b1-b97bf280dd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.204705 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c061692-61c8-4e6f-a6b1-b97bf280dd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.205390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c061692-61c8-4e6f-a6b1-b97bf280dd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.207294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c061692-61c8-4e6f-a6b1-b97bf280dd52 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.321994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1307/2605] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:51:30 2021] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:51:30.325935 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b3679-51e1-4498-af5a-c7f6449e89b7 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.337814 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b3679-51e1-4498-af5a-c7f6449e89b7 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.393606 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b293f20-365d-4e46-bbe6-40d4137d38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.394282 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b293f20-365d-4e46-bbe6-40d4137d38b9 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.394569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b293f20-365d-4e46-bbe6-40d4137d38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.394849 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b293f20-365d-4e46-bbe6-40d4137d38b9 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.395532 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b293f20-365d-4e46-bbe6-40d4137d38b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.397594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b293f20-365d-4e46-bbe6-40d4137d38b9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.490254 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1299/2606] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:51:30 2021] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:30.494658 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c061692-61c8-4e6f-a6b1-b97bf280dd52 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.506478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c061692-61c8-4e6f-a6b1-b97bf280dd52 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.512219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311da1a-6454-4343-bcd2-3f14e5c36c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.513159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311da1a-6454-4343-bcd2-3f14e5c36c55 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.513609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311da1a-6454-4343-bcd2-3f14e5c36c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.514012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311da1a-6454-4343-bcd2-3f14e5c36c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.514834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311da1a-6454-4343-bcd2-3f14e5c36c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.516622 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311da1a-6454-4343-bcd2-3f14e5c36c55 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.527813 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1308/2607] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:30 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:30.532033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b293f20-365d-4e46-bbe6-40d4137d38b9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.542197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b293f20-365d-4e46-bbe6-40d4137d38b9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.546848 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af34da7-5ffb-4672-9aac-cc7fd66a519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.547717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34da7-5ffb-4672-9aac-cc7fd66a519d admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.548001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34da7-5ffb-4672-9aac-cc7fd66a519d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.548278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34da7-5ffb-4672-9aac-cc7fd66a519d admin admin] PATH_INFO: `/v3/projects/3c4c7a2d3ac6489e914ba6d0990c7298/users/4629ff7ec61c4860be676e62b477a944/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.564383 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af34da7-5ffb-4672-9aac-cc7fd66a519d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4c7a2d3ac6489e914ba6d0990c7298, user_id=4629ff7ec61c4860be676e62b477a944, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.568011 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af34da7-5ffb-4672-9aac-cc7fd66a519d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.641370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1300/2608] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:51:30 2021] PUT /identity/v3/projects/3c4c7a2d3ac6489e914ba6d0990c7298/users/4629ff7ec61c4860be676e62b477a944/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:51:30.645520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311da1a-6454-4343-bcd2-3f14e5c36c55 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.656140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311da1a-6454-4343-bcd2-3f14e5c36c55 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.719859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b532d98-b5ef-44b4-8231-83a99b306325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.720568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b532d98-b5ef-44b4-8231-83a99b306325 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.722584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b532d98-b5ef-44b4-8231-83a99b306325 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.722891 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b532d98-b5ef-44b4-8231-83a99b306325 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.723623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b532d98-b5ef-44b4-8231-83a99b306325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.726306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b532d98-b5ef-44b4-8231-83a99b306325 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.736512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1309/2609] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:30 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:30.740888 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af34da7-5ffb-4672-9aac-cc7fd66a519d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.751884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af34da7-5ffb-4672-9aac-cc7fd66a519d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.756550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b899f-50fc-4f25-ba18-78b982ed1d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.758074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b899f-50fc-4f25-ba18-78b982ed1d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.758356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b899f-50fc-4f25-ba18-78b982ed1d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.758632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b899f-50fc-4f25-ba18-78b982ed1d2f admin admin] PATH_INFO: `/v3/projects/3c4c7a2d3ac6489e914ba6d0990c7298/users/4629ff7ec61c4860be676e62b477a944/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.760635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b899f-50fc-4f25-ba18-78b982ed1d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4c7a2d3ac6489e914ba6d0990c7298, user_id=4629ff7ec61c4860be676e62b477a944, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.763306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b899f-50fc-4f25-ba18-78b982ed1d2f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.773578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1301/2610] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:51:30 2021] PUT /identity/v3/projects/3c4c7a2d3ac6489e914ba6d0990c7298/users/4629ff7ec61c4860be676e62b477a944/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:30.783764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea35e61-f9d5-4043-8b81-ee51857a98c9 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.784059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea35e61-f9d5-4043-8b81-ee51857a98c9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.784386 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea35e61-f9d5-4043-8b81-ee51857a98c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.810797 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-2ea35e61-f9d5-4043-8b81-ee51857a98c9 None None] MFA Rules not processed for user `4629ff7ec61c4860be676e62b477a944`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:30.812012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2ea35e61-f9d5-4043-8b81-ee51857a98c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.877624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1310/2611] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:30 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:30.891810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b899f-50fc-4f25-ba18-78b982ed1d2f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.893553 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1d3b899f-50fc-4f25-ba18-78b982ed1d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.949620 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b899f-50fc-4f25-ba18-78b982ed1d2f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.953308 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e83c2-a40e-4e57-8594-21ee9f5ce201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.953950 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e83c2-a40e-4e57-8594-21ee9f5ce201 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.954239 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e83c2-a40e-4e57-8594-21ee9f5ce201 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.954514 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e83c2-a40e-4e57-8594-21ee9f5ce201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:31.009111 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e83c2-a40e-4e57-8594-21ee9f5ce201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:31.010682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e83c2-a40e-4e57-8594-21ee9f5ce201 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:31.020164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1302/2612] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:30 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:36.417506 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea35e61-f9d5-4043-8b81-ee51857a98c9 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:36.418912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2ea35e61-f9d5-4043-8b81-ee51857a98c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:36.430561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea35e61-f9d5-4043-8b81-ee51857a98c9 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:36.434159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abde82-4b34-454b-af3a-e4038732b086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:36.434792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abde82-4b34-454b-af3a-e4038732b086 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:36.435076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abde82-4b34-454b-af3a-e4038732b086 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:36.435352 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abde82-4b34-454b-af3a-e4038732b086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:36.444097 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abde82-4b34-454b-af3a-e4038732b086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:36.446141 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abde82-4b34-454b-af3a-e4038732b086 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:36.456181 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1311/2613] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:36 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:42.262427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e83c2-a40e-4e57-8594-21ee9f5ce201 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:42.321325 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e83c2-a40e-4e57-8594-21ee9f5ce201 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:42.325861 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:42.326717 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:42.327001 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:42.327280 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] PATH_INFO: `/v3/users/cd843a7bd74642d6999b50829bb2f75c` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:42.328494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd843a7bd74642d6999b50829bb2f75c)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:42.330402 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:42.532707 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd843a7bd74642d6999b50829bb2f75c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.544269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd843a7bd74642d6999b50829bb2f75c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.544954 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd843a7bd74642d6999b50829bb2f75c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.551739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd843a7bd74642d6999b50829bb2f75c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.628265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd843a7bd74642d6999b50829bb2f75c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.634488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1303/2614] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:51:42 2021] DELETE /identity/v3/users/cd843a7bd74642d6999b50829bb2f75c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:42.639125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b531-2f10-46f1-b583-849e5751ab65 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:42.644739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b531-2f10-46f1-b583-849e5751ab65 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:42.644739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b531-2f10-46f1-b583-849e5751ab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:42.657865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3d43b531-2f10-46f1-b583-849e5751ab65 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:42.659051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3d43b531-2f10-46f1-b583-849e5751ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:42.715642 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1312/2615] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:42.725699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:42.727710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:42.782222 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f43d1-d206-4308-8f61-8f92cdde1b37 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:42.786046 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44a1d3-3fdb-4396-b9ac-d88286849793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:42.786627 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a1d3-3fdb-4396-b9ac-d88286849793 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:42.786909 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a1d3-3fdb-4396-b9ac-d88286849793 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:42.787185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a1d3-3fdb-4396-b9ac-d88286849793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:42.797124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44a1d3-3fdb-4396-b9ac-d88286849793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:42.798563 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44a1d3-3fdb-4396-b9ac-d88286849793 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:42.808068 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1304/2616] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:43.304541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43b531-2f10-46f1-b583-849e5751ab65 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:43.306568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3d43b531-2f10-46f1-b583-849e5751ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:43.319704 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43b531-2f10-46f1-b583-849e5751ab65 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:43.325396 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:43.326320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:43.326605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:43.326882 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] PATH_INFO: `/v3/projects/632984978d504dabba6a615312a7f21d` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:43.328154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=632984978d504dabba6a615312a7f21d)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:43.330215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:43.462493 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632984978d504dabba6a615312a7f21d', 'request_id': 'req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:43.542110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632984978d504dabba6a615312a7f21d', 'request_id': 'req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:43.547880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632984978d504dabba6a615312a7f21d', 'request_id': 'req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:43.559919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] The token cache is being invalidate because project 632984978d504dabba6a615312a7f21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:43.560205 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:43.560892 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:43.562450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1313/2617] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:51:43 2021] DELETE /identity/v3/projects/632984978d504dabba6a615312a7f21d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:51:43.566591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44a1d3-3fdb-4396-b9ac-d88286849793 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:43.576890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44a1d3-3fdb-4396-b9ac-d88286849793 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:43.630010 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:43.630864 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:43.631143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:43.631414 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] PATH_INFO: `/v3/users/4629ff7ec61c4860be676e62b477a944` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:43.635238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4629ff7ec61c4860be676e62b477a944)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:43.637228 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:43.835973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4629ff7ec61c4860be676e62b477a944'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:43.847306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4629ff7ec61c4860be676e62b477a944'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:43.847977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4629ff7ec61c4860be676e62b477a944'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:43.855464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4629ff7ec61c4860be676e62b477a944'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:43.953960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-6cc10bbc-ba04-40d1-82db-01b8e34ca96a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4629ff7ec61c4860be676e62b477a944'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:43.960052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1305/2618] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:51:43 2021] DELETE /identity/v3/users/4629ff7ec61c4860be676e62b477a944 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:51:44.400661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:44.404762 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:44.415971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3185-6ee5-41ca-9ea9-d9f6ce40ec7f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:44.471643 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:44.472530 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.472818 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.473098 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] PATH_INFO: `/v3/projects/3c4c7a2d3ac6489e914ba6d0990c7298` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.474264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4c7a2d3ac6489e914ba6d0990c7298)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:44.476213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:44.582024 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4c7a2d3ac6489e914ba6d0990c7298', 'request_id': 'req-fedac661-c45b-4015-8dd9-3a464428b98a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:44.645333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4c7a2d3ac6489e914ba6d0990c7298', 'request_id': 'req-fedac661-c45b-4015-8dd9-3a464428b98a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:44.651163 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4c7a2d3ac6489e914ba6d0990c7298', 'request_id': 'req-fedac661-c45b-4015-8dd9-3a464428b98a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:44.662007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] The token cache is being invalidate because project 3c4c7a2d3ac6489e914ba6d0990c7298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:44.662294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:44.662984 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-fedac661-c45b-4015-8dd9-3a464428b98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:44.665080 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1314/2619] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:51:44 2021] DELETE /identity/v3/projects/3c4c7a2d3ac6489e914ba6d0990c7298 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:44.672091 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70649-c138-4d9e-9e05-da5a0348d5b1 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.672695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70649-c138-4d9e-9e05-da5a0348d5b1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.672804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70649-c138-4d9e-9e05-da5a0348d5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.691415 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e4c70649-c138-4d9e-9e05-da5a0348d5b1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:44.692646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e4c70649-c138-4d9e-9e05-da5a0348d5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:44.750506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1306/2620] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:44.759329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea1622-7099-4e29-9480-e2ad3188efcc None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.759634 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea1622-7099-4e29-9480-e2ad3188efcc None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.759912 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea1622-7099-4e29-9480-e2ad3188efcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.778140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-5fea1622-7099-4e29-9480-e2ad3188efcc None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:44.779323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5fea1622-7099-4e29-9480-e2ad3188efcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:44.787096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1315/2621] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:44.792240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c70649-c138-4d9e-9e05-da5a0348d5b1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:44.802080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c70649-c138-4d9e-9e05-da5a0348d5b1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:44.809927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23648c8b-5946-481a-a73c-c36181a05ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:44.810584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23648c8b-5946-481a-a73c-c36181a05ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.810869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23648c8b-5946-481a-a73c-c36181a05ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.811148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23648c8b-5946-481a-a73c-c36181a05ea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.811939 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23648c8b-5946-481a-a73c-c36181a05ea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:44.812179 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23648c8b-5946-481a-a73c-c36181a05ea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:44.813813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23648c8b-5946-481a-a73c-c36181a05ea7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:44.825327 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1307/2622] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:51:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:44.829799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea1622-7099-4e29-9480-e2ad3188efcc None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:44.839409 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea1622-7099-4e29-9480-e2ad3188efcc None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:44.844012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b77f33-dbd0-4c6b-a96a-d096e99b9d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:44.844684 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b77f33-dbd0-4c6b-a96a-d096e99b9d3e admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.844963 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b77f33-dbd0-4c6b-a96a-d096e99b9d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.845237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b77f33-dbd0-4c6b-a96a-d096e99b9d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.845921 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b77f33-dbd0-4c6b-a96a-d096e99b9d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:44.847811 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b77f33-dbd0-4c6b-a96a-d096e99b9d3e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.024569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1316/2623] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:51:44 2021] POST /identity/v3/projects => generated 361 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:45.028858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23648c8b-5946-481a-a73c-c36181a05ea7 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.038509 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23648c8b-5946-481a-a73c-c36181a05ea7 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.091617 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ceece-8493-45b3-a288-6d4b9c266bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.092278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ceece-8493-45b3-a288-6d4b9c266bfb admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.092587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ceece-8493-45b3-a288-6d4b9c266bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.092860 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ceece-8493-45b3-a288-6d4b9c266bfb admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.093537 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ceece-8493-45b3-a288-6d4b9c266bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.095429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ceece-8493-45b3-a288-6d4b9c266bfb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.187739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1308/2624] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:51:45 2021] POST /identity/v3/users => generated 281 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:51:45.189020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b77f33-dbd0-4c6b-a96a-d096e99b9d3e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.200444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b77f33-dbd0-4c6b-a96a-d096e99b9d3e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.205863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06938b-1e84-48db-9378-3039c45d8801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.206749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06938b-1e84-48db-9378-3039c45d8801 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.207211 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06938b-1e84-48db-9378-3039c45d8801 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.207499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06938b-1e84-48db-9378-3039c45d8801 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.208236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06938b-1e84-48db-9378-3039c45d8801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.210019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06938b-1e84-48db-9378-3039c45d8801 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.223030 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1317/2625] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:45 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:51:45.227075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ceece-8493-45b3-a288-6d4b9c266bfb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.236895 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ceece-8493-45b3-a288-6d4b9c266bfb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.241381 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1eb49f-583c-4050-838c-499461868ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.242021 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1eb49f-583c-4050-838c-499461868ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.242302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1eb49f-583c-4050-838c-499461868ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.242592 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1eb49f-583c-4050-838c-499461868ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.243286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1eb49f-583c-4050-838c-499461868ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.244899 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1eb49f-583c-4050-838c-499461868ea0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.254780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1309/2626] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:45 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:45.265061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06938b-1e84-48db-9378-3039c45d8801 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.275869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06938b-1e84-48db-9378-3039c45d8801 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.280620 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ee753-7bc7-41f3-9bda-c3107aa85599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.281604 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ee753-7bc7-41f3-9bda-c3107aa85599 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.281897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ee753-7bc7-41f3-9bda-c3107aa85599 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.282200 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ee753-7bc7-41f3-9bda-c3107aa85599 admin admin] PATH_INFO: `/v3/projects/cdc312c68f4b4af8897f0ef4daa3fd62/users/08d7e387722f4bafbb4a1d8ef5e03fc9/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.296492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ee753-7bc7-41f3-9bda-c3107aa85599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc312c68f4b4af8897f0ef4daa3fd62, user_id=08d7e387722f4bafbb4a1d8ef5e03fc9, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.299176 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ee753-7bc7-41f3-9bda-c3107aa85599 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.406600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1318/2627] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:51:45 2021] PUT /identity/v3/projects/cdc312c68f4b4af8897f0ef4daa3fd62/users/08d7e387722f4bafbb4a1d8ef5e03fc9/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:45.419076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72c051-989c-4da6-807f-3fb52cf77a14 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.419373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72c051-989c-4da6-807f-3fb52cf77a14 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.419658 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72c051-989c-4da6-807f-3fb52cf77a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.445986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-4a72c051-989c-4da6-807f-3fb52cf77a14 None None] MFA Rules not processed for user `08d7e387722f4bafbb4a1d8ef5e03fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:45.447197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4a72c051-989c-4da6-807f-3fb52cf77a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:45.511850 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1310/2628] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:45 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:45.539749 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ee753-7bc7-41f3-9bda-c3107aa85599 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.541580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-d15ee753-7bc7-41f3-9bda-c3107aa85599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:45.597630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ee753-7bc7-41f3-9bda-c3107aa85599 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.601631 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ad596-8a7d-4cdb-a843-24ae78bd9041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.602837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ad596-8a7d-4cdb-a843-24ae78bd9041 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.603125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ad596-8a7d-4cdb-a843-24ae78bd9041 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.603417 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ad596-8a7d-4cdb-a843-24ae78bd9041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.613032 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ad596-8a7d-4cdb-a843-24ae78bd9041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.614499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ad596-8a7d-4cdb-a843-24ae78bd9041 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.623795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1319/2629] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:45 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:45.637478 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72c051-989c-4da6-807f-3fb52cf77a14 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.699869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72c051-989c-4da6-807f-3fb52cf77a14 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.704569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.705485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.705765 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.706042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] PATH_INFO: `/v3/users/08d7e387722f4bafbb4a1d8ef5e03fc9` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.707247 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d7e387722f4bafbb4a1d8ef5e03fc9)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.709209 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.915583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d7e387722f4bafbb4a1d8ef5e03fc9'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:45.927157 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d7e387722f4bafbb4a1d8ef5e03fc9'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:45.929634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d7e387722f4bafbb4a1d8ef5e03fc9'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:45.935183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d7e387722f4bafbb4a1d8ef5e03fc9'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.016589 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d7e387722f4bafbb4a1d8ef5e03fc9'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.023297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1311/2630] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:51:45 2021] DELETE /identity/v3/users/08d7e387722f4bafbb4a1d8ef5e03fc9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:46.028769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363a9f-fff0-4773-89be-14e934e953df None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:46.029103 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363a9f-fff0-4773-89be-14e934e953df None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:46.032420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363a9f-fff0-4773-89be-14e934e953df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:46.046836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e5363a9f-fff0-4773-89be-14e934e953df None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:46.048053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e5363a9f-fff0-4773-89be-14e934e953df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:46.106710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1320/2631] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:46.116920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:46.118356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:46.175486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b59f-cf94-47b2-aaf4-a19138b88a8d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:46.179087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c185c-6922-4319-958f-baba87379699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:46.179744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c185c-6922-4319-958f-baba87379699 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:46.180029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c185c-6922-4319-958f-baba87379699 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:46.180306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c185c-6922-4319-958f-baba87379699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:46.190043 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c185c-6922-4319-958f-baba87379699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:46.191480 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c185c-6922-4319-958f-baba87379699 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:46.201619 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1312/2632] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:46.683874 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363a9f-fff0-4773-89be-14e934e953df None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:46.685747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e5363a9f-fff0-4773-89be-14e934e953df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:46.701508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363a9f-fff0-4773-89be-14e934e953df None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:46.706438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:46.707339 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:46.707624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:46.707889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] PATH_INFO: `/v3/projects/cdc312c68f4b4af8897f0ef4daa3fd62` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:46.709188 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc312c68f4b4af8897f0ef4daa3fd62)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:46.711142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:46.852668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc312c68f4b4af8897f0ef4daa3fd62', 'request_id': 'req-96c7709c-8d58-480f-bff4-21f708a037dd'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.942255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc312c68f4b4af8897f0ef4daa3fd62', 'request_id': 'req-96c7709c-8d58-480f-bff4-21f708a037dd'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.948028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc312c68f4b4af8897f0ef4daa3fd62', 'request_id': 'req-96c7709c-8d58-480f-bff4-21f708a037dd'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.958958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] The token cache is being invalidate because project cdc312c68f4b4af8897f0ef4daa3fd62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:46.959240 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.964645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-96c7709c-8d58-480f-bff4-21f708a037dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.964645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1321/2633] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:51:46 2021] DELETE /identity/v3/projects/cdc312c68f4b4af8897f0ef4daa3fd62 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:46.971877 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd92f2-6209-4b5a-9741-0304cd053873 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:46.972405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd92f2-6209-4b5a-9741-0304cd053873 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:46.972527 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd92f2-6209-4b5a-9741-0304cd053873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:46.990744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-54fd92f2-6209-4b5a-9741-0304cd053873 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:46.991935 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-54fd92f2-6209-4b5a-9741-0304cd053873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.046996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1313/2634] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:47.054690 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd762545-9f97-4d64-a2be-a63be8884f4f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.055008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd762545-9f97-4d64-a2be-a63be8884f4f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.055285 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd762545-9f97-4d64-a2be-a63be8884f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.074233 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-fd762545-9f97-4d64-a2be-a63be8884f4f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:47.075422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-fd762545-9f97-4d64-a2be-a63be8884f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.083076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1322/2635] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:47.087686 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd92f2-6209-4b5a-9741-0304cd053873 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.097178 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd92f2-6209-4b5a-9741-0304cd053873 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.102520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8b123-7ca6-4d11-9069-8f6646542ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.103177 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8b123-7ca6-4d11-9069-8f6646542ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.103461 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8b123-7ca6-4d11-9069-8f6646542ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.103736 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8b123-7ca6-4d11-9069-8f6646542ad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.104502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8b123-7ca6-4d11-9069-8f6646542ad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:47.104814 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8b123-7ca6-4d11-9069-8f6646542ad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.106468 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8b123-7ca6-4d11-9069-8f6646542ad9 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.117682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1314/2636] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:51:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:47.121905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd762545-9f97-4d64-a2be-a63be8884f4f None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.131068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd762545-9f97-4d64-a2be-a63be8884f4f None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.135812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad831c-80ec-4c0a-bc4a-1726568feb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.136492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad831c-80ec-4c0a-bc4a-1726568feb6f admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.136776 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad831c-80ec-4c0a-bc4a-1726568feb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.137048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad831c-80ec-4c0a-bc4a-1726568feb6f admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.137738 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad831c-80ec-4c0a-bc4a-1726568feb6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.139637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad831c-80ec-4c0a-bc4a-1726568feb6f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.223767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1323/2637] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:51:47 2021] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:47.228432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8b123-7ca6-4d11-9069-8f6646542ad9 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.238456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8b123-7ca6-4d11-9069-8f6646542ad9 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.294990 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c1eec-80b0-412d-86b4-c0d636b135dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.295663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c1eec-80b0-412d-86b4-c0d636b135dc admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.295946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c1eec-80b0-412d-86b4-c0d636b135dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.296223 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c1eec-80b0-412d-86b4-c0d636b135dc admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.296945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c1eec-80b0-412d-86b4-c0d636b135dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.298854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c1eec-80b0-412d-86b4-c0d636b135dc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.371386 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1315/2638] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:51:47 2021] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:47.375229 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad831c-80ec-4c0a-bc4a-1726568feb6f admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.386076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad831c-80ec-4c0a-bc4a-1726568feb6f admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.391118 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22011def-34bf-400e-ac47-988db25d27b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.391926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22011def-34bf-400e-ac47-988db25d27b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.392237 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22011def-34bf-400e-ac47-988db25d27b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.392555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22011def-34bf-400e-ac47-988db25d27b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.393289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22011def-34bf-400e-ac47-988db25d27b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.394976 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22011def-34bf-400e-ac47-988db25d27b3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.406535 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1324/2639] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:47 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:47.410735 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c1eec-80b0-412d-86b4-c0d636b135dc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.420550 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c1eec-80b0-412d-86b4-c0d636b135dc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.425125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d245ed1-2ad8-484a-b6c1-8157314ad1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.425768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d245ed1-2ad8-484a-b6c1-8157314ad1ba admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.426047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d245ed1-2ad8-484a-b6c1-8157314ad1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.426317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d245ed1-2ad8-484a-b6c1-8157314ad1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.427025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d245ed1-2ad8-484a-b6c1-8157314ad1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.428631 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d245ed1-2ad8-484a-b6c1-8157314ad1ba admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.438315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1316/2640] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:47 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:47.442724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22011def-34bf-400e-ac47-988db25d27b3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.453469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22011def-34bf-400e-ac47-988db25d27b3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.458114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9f7cf-6c9a-4e28-8bde-1d6541720a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.458977 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9f7cf-6c9a-4e28-8bde-1d6541720a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.459257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9f7cf-6c9a-4e28-8bde-1d6541720a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.459528 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9f7cf-6c9a-4e28-8bde-1d6541720a9a admin admin] PATH_INFO: `/v3/projects/6edc3f27271a406fba1e4f4bcd56357f/users/4ffac190990b4d70ada397912e59062c/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.474732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9f7cf-6c9a-4e28-8bde-1d6541720a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edc3f27271a406fba1e4f4bcd56357f, user_id=4ffac190990b4d70ada397912e59062c, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.477384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9f7cf-6c9a-4e28-8bde-1d6541720a9a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.570931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1325/2641] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:51:47 2021] PUT /identity/v3/projects/6edc3f27271a406fba1e4f4bcd56357f/users/4ffac190990b4d70ada397912e59062c/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:47.581161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449ac15-d3e2-47ce-8067-14842c69ecc5 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.581481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449ac15-d3e2-47ce-8067-14842c69ecc5 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.581762 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449ac15-d3e2-47ce-8067-14842c69ecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.614330 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d449ac15-d3e2-47ce-8067-14842c69ecc5 None None] MFA Rules not processed for user `4ffac190990b4d70ada397912e59062c`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:47.615554 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d449ac15-d3e2-47ce-8067-14842c69ecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.677498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1317/2642] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:47 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:47.687880 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9f7cf-6c9a-4e28-8bde-1d6541720a9a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.689620 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-93e9f7cf-6c9a-4e28-8bde-1d6541720a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.745319 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9f7cf-6c9a-4e28-8bde-1d6541720a9a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.748931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35190a3-f2c6-4e5d-b88a-b631fcf50444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.749602 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35190a3-f2c6-4e5d-b88a-b631fcf50444 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.749887 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35190a3-f2c6-4e5d-b88a-b631fcf50444 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.750166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35190a3-f2c6-4e5d-b88a-b631fcf50444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.759203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35190a3-f2c6-4e5d-b88a-b631fcf50444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.760684 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35190a3-f2c6-4e5d-b88a-b631fcf50444 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.769407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1326/2643] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:47 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:47.793844 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449ac15-d3e2-47ce-8067-14842c69ecc5 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.855780 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449ac15-d3e2-47ce-8067-14842c69ecc5 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.860649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.861521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.861803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.862080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] PATH_INFO: `/v3/users/4ffac190990b4d70ada397912e59062c` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.863285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffac190990b4d70ada397912e59062c)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.865273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:48.029476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffac190990b4d70ada397912e59062c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.040615 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffac190990b4d70ada397912e59062c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.041289 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffac190990b4d70ada397912e59062c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.048020 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffac190990b4d70ada397912e59062c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.096062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffac190990b4d70ada397912e59062c'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.102356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1318/2644] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 04:51:47 2021] DELETE /identity/v3/users/4ffac190990b4d70ada397912e59062c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:48.106872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ee831-e3ba-4370-b175-5c48dd3bd071 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:48.107164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ee831-e3ba-4370-b175-5c48dd3bd071 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:48.107442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ee831-e3ba-4370-b175-5c48dd3bd071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:48.125546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-dd3ee831-e3ba-4370-b175-5c48dd3bd071 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:48.127011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-dd3ee831-e3ba-4370-b175-5c48dd3bd071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:48.183707 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1327/2645] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:48.193649 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:48.195039 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:48.249637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a697eed-117e-4a61-91f5-61b8c8ed21c0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:48.253653 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e11223-66d7-476e-bf21-9d40c8e57210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:48.254298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e11223-66d7-476e-bf21-9d40c8e57210 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:48.254580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e11223-66d7-476e-bf21-9d40c8e57210 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:48.254856 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e11223-66d7-476e-bf21-9d40c8e57210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:48.264825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e11223-66d7-476e-bf21-9d40c8e57210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:48.266259 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e11223-66d7-476e-bf21-9d40c8e57210 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:48.275714 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1319/2646] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:48.664122 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ee831-e3ba-4370-b175-5c48dd3bd071 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:48.666355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-dd3ee831-e3ba-4370-b175-5c48dd3bd071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:48.684814 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ee831-e3ba-4370-b175-5c48dd3bd071 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:48.690563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:48.691489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:48.691770 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:48.692046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] PATH_INFO: `/v3/projects/6edc3f27271a406fba1e4f4bcd56357f` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:48.693336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edc3f27271a406fba1e4f4bcd56357f)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:48.695414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:48.815514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edc3f27271a406fba1e4f4bcd56357f', 'request_id': 'req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.884808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edc3f27271a406fba1e4f4bcd56357f', 'request_id': 'req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.890555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edc3f27271a406fba1e4f4bcd56357f', 'request_id': 'req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.902199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] The token cache is being invalidate because project 6edc3f27271a406fba1e4f4bcd56357f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:48.902486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.903566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8c7f7ae7-c309-4a1a-a498-b2c5d21d0740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.904782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1328/2647] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 04:51:48 2021] DELETE /identity/v3/projects/6edc3f27271a406fba1e4f4bcd56357f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:48.912198 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fef4a-1db9-42d6-a0f8-00109211b2c1 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:48.912528 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fef4a-1db9-42d6-a0f8-00109211b2c1 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:48.912817 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fef4a-1db9-42d6-a0f8-00109211b2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:48.930446 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f18fef4a-1db9-42d6-a0f8-00109211b2c1 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:48.931795 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f18fef4a-1db9-42d6-a0f8-00109211b2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:48.989812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1320/2648] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:48.997842 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae29c-ee2f-41b8-88e6-eb40c2f2178b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:48.998131 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae29c-ee2f-41b8-88e6-eb40c2f2178b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:48.998407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae29c-ee2f-41b8-88e6-eb40c2f2178b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.017221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-1eaae29c-ee2f-41b8-88e6-eb40c2f2178b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:49.018429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1eaae29c-ee2f-41b8-88e6-eb40c2f2178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:49.027104 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1329/2649] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:49.031341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fef4a-1db9-42d6-a0f8-00109211b2c1 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.040763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fef4a-1db9-42d6-a0f8-00109211b2c1 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.045538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ab90-153e-4f35-affa-218e35594b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.046182 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ab90-153e-4f35-affa-218e35594b15 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.046464 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ab90-153e-4f35-affa-218e35594b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.046738 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ab90-153e-4f35-affa-218e35594b15 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.047452 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1ab90-153e-4f35-affa-218e35594b15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:49.047759 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1ab90-153e-4f35-affa-218e35594b15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.049374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1ab90-153e-4f35-affa-218e35594b15 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.060575 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1321/2650] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 04:51:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:49.065053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaae29c-ee2f-41b8-88e6-eb40c2f2178b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.074758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaae29c-ee2f-41b8-88e6-eb40c2f2178b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.079473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714214ce-c122-400d-9c2a-ec6683798273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.080117 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714214ce-c122-400d-9c2a-ec6683798273 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.080434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714214ce-c122-400d-9c2a-ec6683798273 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.080713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714214ce-c122-400d-9c2a-ec6683798273 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.081414 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714214ce-c122-400d-9c2a-ec6683798273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.083317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714214ce-c122-400d-9c2a-ec6683798273 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.265839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1330/2651] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 04:51:49 2021] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:51:49.268616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ab90-153e-4f35-affa-218e35594b15 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.279371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ab90-153e-4f35-affa-218e35594b15 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.334943 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2142e-fd71-485d-88b0-20ec9b7c7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.335534 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2142e-fd71-485d-88b0-20ec9b7c7af3 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.335830 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2142e-fd71-485d-88b0-20ec9b7c7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.336123 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2142e-fd71-485d-88b0-20ec9b7c7af3 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.336844 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2142e-fd71-485d-88b0-20ec9b7c7af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.338781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2142e-fd71-485d-88b0-20ec9b7c7af3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.427737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1322/2652] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 04:51:49 2021] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:49.432566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714214ce-c122-400d-9c2a-ec6683798273 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.442860 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714214ce-c122-400d-9c2a-ec6683798273 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.448116 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3a677-fc5b-4fe3-9726-3454fc428de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.448805 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3a677-fc5b-4fe3-9726-3454fc428de2 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.449143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3a677-fc5b-4fe3-9726-3454fc428de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.449422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3a677-fc5b-4fe3-9726-3454fc428de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.450151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3a677-fc5b-4fe3-9726-3454fc428de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.451869 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3a677-fc5b-4fe3-9726-3454fc428de2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.462213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1331/2653] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:51:49.466350 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2142e-fd71-485d-88b0-20ec9b7c7af3 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.476374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2142e-fd71-485d-88b0-20ec9b7c7af3 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.480919 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f73863-0add-4274-adf3-6620e177033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.481568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f73863-0add-4274-adf3-6620e177033c admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.481854 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f73863-0add-4274-adf3-6620e177033c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.482128 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f73863-0add-4274-adf3-6620e177033c admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.482842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f73863-0add-4274-adf3-6620e177033c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.484444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f73863-0add-4274-adf3-6620e177033c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.494470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1323/2654] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 04:51:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:49.498534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3a677-fc5b-4fe3-9726-3454fc428de2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.509406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3a677-fc5b-4fe3-9726-3454fc428de2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.514071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cd521-4589-4258-90e5-09a450186c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.514946 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cd521-4589-4258-90e5-09a450186c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.515226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cd521-4589-4258-90e5-09a450186c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.515500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cd521-4589-4258-90e5-09a450186c29 admin admin] PATH_INFO: `/v3/projects/fa9bf6413b134bb38daf4ef2cdebc5b5/users/dc40b5a2420e4b45804f00bcb82312c7/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.529762 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cd521-4589-4258-90e5-09a450186c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9bf6413b134bb38daf4ef2cdebc5b5, user_id=dc40b5a2420e4b45804f00bcb82312c7, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.532482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cd521-4589-4258-90e5-09a450186c29 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.616425 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1332/2655] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 04:51:49 2021] PUT /identity/v3/projects/fa9bf6413b134bb38daf4ef2cdebc5b5/users/dc40b5a2420e4b45804f00bcb82312c7/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:51:49.622012 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa242c-e373-4cb3-97e9-7522be9cee8f None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.622336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa242c-e373-4cb3-97e9-7522be9cee8f None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.622610 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa242c-e373-4cb3-97e9-7522be9cee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.641243 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-e1fa242c-e373-4cb3-97e9-7522be9cee8f None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:49.642441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e1fa242c-e373-4cb3-97e9-7522be9cee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:49.699946 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1324/2656] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:49.709844 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cd521-4589-4258-90e5-09a450186c29 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.711634 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9b6cd521-4589-4258-90e5-09a450186c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:49.766464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cd521-4589-4258-90e5-09a450186c29 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.770099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd3f3-2abd-4602-bca3-2c69292bf67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.770742 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd3f3-2abd-4602-bca3-2c69292bf67c service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.771024 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd3f3-2abd-4602-bca3-2c69292bf67c service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.771304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd3f3-2abd-4602-bca3-2c69292bf67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.780259 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cd3f3-2abd-4602-bca3-2c69292bf67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.781736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cd3f3-2abd-4602-bca3-2c69292bf67c service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.791626 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1333/2657] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:51.243811 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3172ba-3314-4e46-8d77-4291a3a9aaa7 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:51.244385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3172ba-3314-4e46-8d77-4291a3a9aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:51.244385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3172ba-3314-4e46-8d77-4291a3a9aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:51.272572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-5b3172ba-3314-4e46-8d77-4291a3a9aaa7 None None] MFA Rules not processed for user `dc40b5a2420e4b45804f00bcb82312c7`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:51.273818 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5b3172ba-3314-4e46-8d77-4291a3a9aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:51.337629 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1325/2658] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:51 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:51.347784 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd3f3-2abd-4602-bca3-2c69292bf67c service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:51.349341 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b96cd3f3-2abd-4602-bca3-2c69292bf67c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:51.407611 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd3f3-2abd-4602-bca3-2c69292bf67c service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:51.411390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2830d91-899b-450b-8099-632c4a0e2403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:51.412065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2830d91-899b-450b-8099-632c4a0e2403 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:51.412345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2830d91-899b-450b-8099-632c4a0e2403 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:51.412648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2830d91-899b-450b-8099-632c4a0e2403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:51.421297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2830d91-899b-450b-8099-632c4a0e2403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:51.422740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2830d91-899b-450b-8099-632c4a0e2403 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:51.432161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1334/2659] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:51 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:52.055807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3172ba-3314-4e46-8d77-4291a3a9aaa7 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:52.057262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5b3172ba-3314-4e46-8d77-4291a3a9aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:52.069812 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3172ba-3314-4e46-8d77-4291a3a9aaa7 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:52.074145 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf74ef8-4bd1-4d64-88a5-86abf9da3594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:52.074801 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf74ef8-4bd1-4d64-88a5-86abf9da3594 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:52.083422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf74ef8-4bd1-4d64-88a5-86abf9da3594 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:52.083422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf74ef8-4bd1-4d64-88a5-86abf9da3594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:52.083422 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8bf74ef8-4bd1-4d64-88a5-86abf9da3594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:52.136045 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf74ef8-4bd1-4d64-88a5-86abf9da3594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:52.137523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf74ef8-4bd1-4d64-88a5-86abf9da3594 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:52.146650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1326/2660] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:51:52 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:51:53.195160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc032843-1703-42fd-8c42-90d4c230a092 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.195657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc032843-1703-42fd-8c42-90d4c230a092 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.195657 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc032843-1703-42fd-8c42-90d4c230a092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.213173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-dc032843-1703-42fd-8c42-90d4c230a092 None None] MFA Rules not processed for user `dc40b5a2420e4b45804f00bcb82312c7`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:53.214370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-dc032843-1703-42fd-8c42-90d4c230a092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:53.221426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1335/2661] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:51:53 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:00.673149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48b30-b8ff-4544-9646-0dd60f47563a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:00.673655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48b30-b8ff-4544-9646-0dd60f47563a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:00.673769 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48b30-b8ff-4544-9646-0dd60f47563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:00.691211 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-81e48b30-b8ff-4544-9646-0dd60f47563a None None] MFA Rules not processed for user `541c688efdf8455c9a083ca11f2678be`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:00.692426 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-81e48b30-b8ff-4544-9646-0dd60f47563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:00.699325 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1327/2662] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 04:52:00 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:01.022555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc032843-1703-42fd-8c42-90d4c230a092 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:01.032547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc032843-1703-42fd-8c42-90d4c230a092 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:01.036147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29b5ff-204e-43a2-94d5-08095e6ffd3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:01.036944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29b5ff-204e-43a2-94d5-08095e6ffd3a service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:01.037232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29b5ff-204e-43a2-94d5-08095e6ffd3a service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:01.037511 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29b5ff-204e-43a2-94d5-08095e6ffd3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:01.039277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-fe29b5ff-204e-43a2-94d5-08095e6ffd3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:01.048629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29b5ff-204e-43a2-94d5-08095e6ffd3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:01.050059 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29b5ff-204e-43a2-94d5-08095e6ffd3a service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:01.057903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1336/2663] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:52:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:19.688772 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48b30-b8ff-4544-9646-0dd60f47563a None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:19.690253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-81e48b30-b8ff-4544-9646-0dd60f47563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:19.761458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48b30-b8ff-4544-9646-0dd60f47563a None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:19.766572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36245-acb9-43f0-b429-1cadb9d7f4aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:19.767224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36245-acb9-43f0-b429-1cadb9d7f4aa service placement] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:19.767501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36245-acb9-43f0-b429-1cadb9d7f4aa service placement] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:19.767773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36245-acb9-43f0-b429-1cadb9d7f4aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:19.769580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8bc36245-acb9-43f0-b429-1cadb9d7f4aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:19.781056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc36245-acb9-43f0-b429-1cadb9d7f4aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:19.782635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc36245-acb9-43f0-b429-1cadb9d7f4aa service placement] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:19.792529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1328/2664] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:52:19 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:54.778504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29b5ff-204e-43a2-94d5-08095e6ffd3a service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:54.787553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29b5ff-204e-43a2-94d5-08095e6ffd3a service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:54.791044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48d9ef-4da0-42cf-adba-278776568b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:54.791668 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48d9ef-4da0-42cf-adba-278776568b98 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:54.791945 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48d9ef-4da0-42cf-adba-278776568b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:54.792904 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48d9ef-4da0-42cf-adba-278776568b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:54.794710 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9e48d9ef-4da0-42cf-adba-278776568b98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:54.854006 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48d9ef-4da0-42cf-adba-278776568b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:54.856146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48d9ef-4da0-42cf-adba-278776568b98 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:54.865647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1337/2665] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:52:54 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:07.571098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36245-acb9-43f0-b429-1cadb9d7f4aa service placement] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:07.580538 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36245-acb9-43f0-b429-1cadb9d7f4aa service placement] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:07.584253 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9f7d7-909c-4bb0-a097-da88e812d2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:07.584914 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9f7d7-909c-4bb0-a097-da88e812d2fd service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:07.585206 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9f7d7-909c-4bb0-a097-da88e812d2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:07.585486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9f7d7-909c-4bb0-a097-da88e812d2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:07.587272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8ce9f7d7-909c-4bb0-a097-da88e812d2fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:07.656117 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9f7d7-909c-4bb0-a097-da88e812d2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:07.657588 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9f7d7-909c-4bb0-a097-da88e812d2fd service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:07.670066 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1329/2666] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:54:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:39.381538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48d9ef-4da0-42cf-adba-278776568b98 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:39.382997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9e48d9ef-4da0-42cf-adba-278776568b98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:39.394873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48d9ef-4da0-42cf-adba-278776568b98 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:39.398577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2727a7e-f321-4532-8a8d-16957f365322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:39.399764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2727a7e-f321-4532-8a8d-16957f365322 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:39.400047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2727a7e-f321-4532-8a8d-16957f365322 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:39.400323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2727a7e-f321-4532-8a8d-16957f365322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:39.402048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a2727a7e-f321-4532-8a8d-16957f365322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:39.415439 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2727a7e-f321-4532-8a8d-16957f365322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:39.416855 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2727a7e-f321-4532-8a8d-16957f365322 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:39.427577 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1338/2667] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:54:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:21.367348 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9f7d7-909c-4bb0-a097-da88e812d2fd service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:21.375721 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9f7d7-909c-4bb0-a097-da88e812d2fd service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:21.379347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3be029-2669-4acc-8ec9-36683f7e5169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:21.379977 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3be029-2669-4acc-8ec9-36683f7e5169 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:21.380255 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3be029-2669-4acc-8ec9-36683f7e5169 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:21.380561 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3be029-2669-4acc-8ec9-36683f7e5169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:21.382846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6e3be029-2669-4acc-8ec9-36683f7e5169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:21.392072 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3be029-2669-4acc-8ec9-36683f7e5169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:21.393520 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3be029-2669-4acc-8ec9-36683f7e5169 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:21.401985 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1330/2668] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:56:21 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:50.872230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2727a7e-f321-4532-8a8d-16957f365322 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:50.891370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2727a7e-f321-4532-8a8d-16957f365322 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:50.895088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1557d7-fa40-490d-8168-5f59728b6bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:50.895725 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1557d7-fa40-490d-8168-5f59728b6bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:50.896012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1557d7-fa40-490d-8168-5f59728b6bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:50.896289 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1557d7-fa40-490d-8168-5f59728b6bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:50.920454 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1557d7-fa40-490d-8168-5f59728b6bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:50.922360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1557d7-fa40-490d-8168-5f59728b6bd5 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:50.931300 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1339/2669] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:56:50 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:52.786015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3be029-2669-4acc-8ec9-36683f7e5169 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:52.804829 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3be029-2669-4acc-8ec9-36683f7e5169 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:52.808570 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75370891-9019-4385-8ae0-87bac202380e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:52.809202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75370891-9019-4385-8ae0-87bac202380e service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:52.809476 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75370891-9019-4385-8ae0-87bac202380e service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:52.809748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75370891-9019-4385-8ae0-87bac202380e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:52.818078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75370891-9019-4385-8ae0-87bac202380e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:52.819493 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75370891-9019-4385-8ae0-87bac202380e service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:52.846519 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1331/2670] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:56:52 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:22.609442 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1557d7-fa40-490d-8168-5f59728b6bd5 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:22.610934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ff1557d7-fa40-490d-8168-5f59728b6bd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:22.673088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1557d7-fa40-490d-8168-5f59728b6bd5 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:22.678183 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacb06a-77cb-49d5-8bca-22ebc299f81d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:22.678831 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacb06a-77cb-49d5-8bca-22ebc299f81d service placement] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:22.679114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacb06a-77cb-49d5-8bca-22ebc299f81d service placement] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:22.679389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacb06a-77cb-49d5-8bca-22ebc299f81d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:22.688005 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacb06a-77cb-49d5-8bca-22ebc299f81d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:22.689629 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacb06a-77cb-49d5-8bca-22ebc299f81d service placement] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:22.700455 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1340/2671] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:57:22 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:54.539124 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75370891-9019-4385-8ae0-87bac202380e service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:54.557513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75370891-9019-4385-8ae0-87bac202380e service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:54.561180 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b297fd6-4eb6-4784-ab44-bfbad50260b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:54.561819 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b297fd6-4eb6-4784-ab44-bfbad50260b8 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:54.562098 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b297fd6-4eb6-4784-ab44-bfbad50260b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:54.562373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b297fd6-4eb6-4784-ab44-bfbad50260b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:54.570640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b297fd6-4eb6-4784-ab44-bfbad50260b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:54.572616 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b297fd6-4eb6-4784-ab44-bfbad50260b8 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:54.598549 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1332/2672] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 04:57:54 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:25.366550 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacb06a-77cb-49d5-8bca-22ebc299f81d service placement] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:25.387346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacb06a-77cb-49d5-8bca-22ebc299f81d service placement] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:25.391587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36451b-b293-4715-aba1-8b4b8bce5a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:25.392264 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36451b-b293-4715-aba1-8b4b8bce5a9a service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:25.392566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36451b-b293-4715-aba1-8b4b8bce5a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:25.392839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36451b-b293-4715-aba1-8b4b8bce5a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:25.400948 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36451b-b293-4715-aba1-8b4b8bce5a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:25.402403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36451b-b293-4715-aba1-8b4b8bce5a9a service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:25.411661 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1341/2673] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:01:25 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:51.670725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b297fd6-4eb6-4784-ab44-bfbad50260b8 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:51.723129 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b297fd6-4eb6-4784-ab44-bfbad50260b8 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:51.726871 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d3cd3-3fcd-4bd7-8005-44a3f384c0b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:51.727515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d3cd3-3fcd-4bd7-8005-44a3f384c0b5 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:51.727790 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d3cd3-3fcd-4bd7-8005-44a3f384c0b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:51.728060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d3cd3-3fcd-4bd7-8005-44a3f384c0b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:51.729948 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7e1d3cd3-3fcd-4bd7-8005-44a3f384c0b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:51.804168 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d3cd3-3fcd-4bd7-8005-44a3f384c0b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:51.805635 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d3cd3-3fcd-4bd7-8005-44a3f384c0b5 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:51.823146 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1333/2674] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:01:51 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:52.227613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36451b-b293-4715-aba1-8b4b8bce5a9a service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:52.229274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-cd36451b-b293-4715-aba1-8b4b8bce5a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:52.253385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36451b-b293-4715-aba1-8b4b8bce5a9a service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:52.257214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d560-a2b1-495c-a7f9-696b5d7b40e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:52.257852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d560-a2b1-495c-a7f9-696b5d7b40e9 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:52.258133 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d560-a2b1-495c-a7f9-696b5d7b40e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:52.258408 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d560-a2b1-495c-a7f9-696b5d7b40e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:52.260226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b9f1d560-a2b1-495c-a7f9-696b5d7b40e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:52.330433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1d560-a2b1-495c-a7f9-696b5d7b40e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:52.331868 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1d560-a2b1-495c-a7f9-696b5d7b40e9 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:52.341232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1342/2675] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:01:52 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:26.633378 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d3cd3-3fcd-4bd7-8005-44a3f384c0b5 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:26.634945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7e1d3cd3-3fcd-4bd7-8005-44a3f384c0b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:26.702479 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d3cd3-3fcd-4bd7-8005-44a3f384c0b5 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:26.707624 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d94ea-fc75-4eda-b98d-2b7f71f850e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:26.708278 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d94ea-fc75-4eda-b98d-2b7f71f850e4 service placement] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:26.708596 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d94ea-fc75-4eda-b98d-2b7f71f850e4 service placement] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:26.708875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d94ea-fc75-4eda-b98d-2b7f71f850e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:26.711385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-874d94ea-fc75-4eda-b98d-2b7f71f850e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:26.725148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d94ea-fc75-4eda-b98d-2b7f71f850e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:26.726733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d94ea-fc75-4eda-b98d-2b7f71f850e4 service placement] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:26.737048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1334/2676] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:02:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:54.291273 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d560-a2b1-495c-a7f9-696b5d7b40e9 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:54.292747 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b9f1d560-a2b1-495c-a7f9-696b5d7b40e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:54.336850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d560-a2b1-495c-a7f9-696b5d7b40e9 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:54.342310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5834ab-23fe-470b-9d85-16f244c69e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:54.342953 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5834ab-23fe-470b-9d85-16f244c69e50 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:54.343228 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5834ab-23fe-470b-9d85-16f244c69e50 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:54.343498 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5834ab-23fe-470b-9d85-16f244c69e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:54.351785 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5834ab-23fe-470b-9d85-16f244c69e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:54.353451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5834ab-23fe-470b-9d85-16f244c69e50 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:54.362938 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1343/2677] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:02:54 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:33.122041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d94ea-fc75-4eda-b98d-2b7f71f850e4 service placement] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:33.123783 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-874d94ea-fc75-4eda-b98d-2b7f71f850e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:33.195370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d94ea-fc75-4eda-b98d-2b7f71f850e4 service placement] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:33.199578 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d4fdb-c701-4c24-b56d-e67a9999d150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:33.200272 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4fdb-c701-4c24-b56d-e67a9999d150 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:33.200618 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4fdb-c701-4c24-b56d-e67a9999d150 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:33.200898 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4fdb-c701-4c24-b56d-e67a9999d150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:33.202914 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-697d4fdb-c701-4c24-b56d-e67a9999d150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:33.279074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d4fdb-c701-4c24-b56d-e67a9999d150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:33.280891 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d4fdb-c701-4c24-b56d-e67a9999d150 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:33.292900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1335/2678] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:04:33 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:34.460000 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5834ab-23fe-470b-9d85-16f244c69e50 service nova] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:34.543303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5834ab-23fe-470b-9d85-16f244c69e50 service nova] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:34.549046 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f94c85-b0f2-48df-bbc4-bad95fe99fe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:34.549698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f94c85-b0f2-48df-bbc4-bad95fe99fe7 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:34.549985 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f94c85-b0f2-48df-bbc4-bad95fe99fe7 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:34.550262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f94c85-b0f2-48df-bbc4-bad95fe99fe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:34.553512 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-73f94c85-b0f2-48df-bbc4-bad95fe99fe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:34.569740 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f94c85-b0f2-48df-bbc4-bad95fe99fe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:34.572575 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f94c85-b0f2-48df-bbc4-bad95fe99fe7 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:34.582674 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1344/2679] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:04:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:35.573450 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d4fdb-c701-4c24-b56d-e67a9999d150 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:35.582726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d4fdb-c701-4c24-b56d-e67a9999d150 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:35.586885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ba5a9-fd69-4f2f-a991-f3494a799e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:35.587588 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba5a9-fd69-4f2f-a991-f3494a799e77 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:35.587937 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba5a9-fd69-4f2f-a991-f3494a799e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:35.588189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba5a9-fd69-4f2f-a991-f3494a799e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:35.599750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ba5a9-fd69-4f2f-a991-f3494a799e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:35.601248 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ba5a9-fd69-4f2f-a991-f3494a799e77 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:35.614343 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1336/2680] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:04:35 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:31.361806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f94c85-b0f2-48df-bbc4-bad95fe99fe7 service nova] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:31.363523 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-73f94c85-b0f2-48df-bbc4-bad95fe99fe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:31.379651 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f94c85-b0f2-48df-bbc4-bad95fe99fe7 service nova] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:31.386731 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e93ab-2715-4152-9db5-67489ef873e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:31.387878 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e93ab-2715-4152-9db5-67489ef873e6 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:31.388397 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e93ab-2715-4152-9db5-67489ef873e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:31.388836 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e93ab-2715-4152-9db5-67489ef873e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:31.391868 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9f1e93ab-2715-4152-9db5-67489ef873e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:31.409421 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e93ab-2715-4152-9db5-67489ef873e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:31.411779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e93ab-2715-4152-9db5-67489ef873e6 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:31.426958 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1345/2681] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:06:31 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:50.270097 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ba5a9-fd69-4f2f-a991-f3494a799e77 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:50.279667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ba5a9-fd69-4f2f-a991-f3494a799e77 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:50.284099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036d37-d4f3-4761-ad5c-58b3a28a4fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:50.284773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036d37-d4f3-4761-ad5c-58b3a28a4fca service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:50.285056 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036d37-d4f3-4761-ad5c-58b3a28a4fca service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:50.285333 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036d37-d4f3-4761-ad5c-58b3a28a4fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:50.294064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6036d37-d4f3-4761-ad5c-58b3a28a4fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:50.295518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6036d37-d4f3-4761-ad5c-58b3a28a4fca service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:50.304432 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1337/2682] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:06:50 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:52.179412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e93ab-2715-4152-9db5-67489ef873e6 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:52.181140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9f1e93ab-2715-4152-9db5-67489ef873e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:52.193402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e93ab-2715-4152-9db5-67489ef873e6 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:52.197041 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8042f4-80db-4b48-9566-409724b623e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:52.197712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8042f4-80db-4b48-9566-409724b623e7 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:52.197991 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8042f4-80db-4b48-9566-409724b623e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:52.198262 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8042f4-80db-4b48-9566-409724b623e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:52.222801 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8042f4-80db-4b48-9566-409724b623e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:52.224269 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8042f4-80db-4b48-9566-409724b623e7 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:52.234720 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1346/2683] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:06:52 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:34.660380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036d37-d4f3-4761-ad5c-58b3a28a4fca service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:34.661986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-e6036d37-d4f3-4761-ad5c-58b3a28a4fca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:34.747905 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036d37-d4f3-4761-ad5c-58b3a28a4fca service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:34.753263 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226e26-6db1-41ec-904b-08699127cb46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:34.753913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226e26-6db1-41ec-904b-08699127cb46 service placement] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:34.754197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226e26-6db1-41ec-904b-08699127cb46 service placement] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:34.754474 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226e26-6db1-41ec-904b-08699127cb46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:34.763011 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3226e26-6db1-41ec-904b-08699127cb46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:34.764639 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3226e26-6db1-41ec-904b-08699127cb46 service placement] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:34.774323 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1338/2684] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:07:34 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:55.009321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8042f4-80db-4b48-9566-409724b623e7 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:55.038083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8042f4-80db-4b48-9566-409724b623e7 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:55.041732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb913df-1c6c-41e5-bb92-25ca6d899c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:55.042366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb913df-1c6c-41e5-bb92-25ca6d899c75 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:55.042649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb913df-1c6c-41e5-bb92-25ca6d899c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:55.042926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb913df-1c6c-41e5-bb92-25ca6d899c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:55.044825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-edb913df-1c6c-41e5-bb92-25ca6d899c75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:55.120613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb913df-1c6c-41e5-bb92-25ca6d899c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:55.122039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb913df-1c6c-41e5-bb92-25ca6d899c75 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:55.140547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1347/2685] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:07:55 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:09:33.031880 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226e26-6db1-41ec-904b-08699127cb46 service placement] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:09:33.041756 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226e26-6db1-41ec-904b-08699127cb46 service placement] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:09:33.045424 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142b0ad-16ee-47a1-b224-ce8509319aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:09:33.046064 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142b0ad-16ee-47a1-b224-ce8509319aff service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:09:33.046352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142b0ad-16ee-47a1-b224-ce8509319aff service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:09:33.046632 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142b0ad-16ee-47a1-b224-ce8509319aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:09:33.057511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142b0ad-16ee-47a1-b224-ce8509319aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:09:33.058930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142b0ad-16ee-47a1-b224-ce8509319aff service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:09:33.069675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1339/2686] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:09:33 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:09:36.375063 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb913df-1c6c-41e5-bb92-25ca6d899c75 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:09:36.384491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb913df-1c6c-41e5-bb92-25ca6d899c75 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:09:36.388247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70019ad-d4a2-4919-b968-da2944deede2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:09:36.389384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70019ad-d4a2-4919-b968-da2944deede2 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:09:36.389384 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70019ad-d4a2-4919-b968-da2944deede2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:09:36.389595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70019ad-d4a2-4919-b968-da2944deede2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:09:36.392011 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f70019ad-d4a2-4919-b968-da2944deede2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:09:36.406001 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70019ad-d4a2-4919-b968-da2944deede2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:09:36.408143 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70019ad-d4a2-4919-b968-da2944deede2 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:09:36.419866 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1348/2687] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:09:36 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:11:39.348524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142b0ad-16ee-47a1-b224-ce8509319aff service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:39.366494 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142b0ad-16ee-47a1-b224-ce8509319aff service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:39.370154 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1660e8-9af1-4a93-b597-111672ca8cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:39.370791 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1660e8-9af1-4a93-b597-111672ca8cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:39.371073 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1660e8-9af1-4a93-b597-111672ca8cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:39.371349 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1660e8-9af1-4a93-b597-111672ca8cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:39.378535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1660e8-9af1-4a93-b597-111672ca8cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:39.379948 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1660e8-9af1-4a93-b597-111672ca8cc6 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:39.387759 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1340/2688] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:11:39 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:11:50.787113 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70019ad-d4a2-4919-b968-da2944deede2 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:50.796310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70019ad-d4a2-4919-b968-da2944deede2 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:50.800428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a27ede-6e39-4f3b-ad58-285e61994abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:50.801057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27ede-6e39-4f3b-ad58-285e61994abf service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:50.801335 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27ede-6e39-4f3b-ad58-285e61994abf service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:50.801607 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27ede-6e39-4f3b-ad58-285e61994abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:50.809654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a27ede-6e39-4f3b-ad58-285e61994abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:50.811082 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a27ede-6e39-4f3b-ad58-285e61994abf service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:50.820249 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1349/2689] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:11:50 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:11:52.395303 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1660e8-9af1-4a93-b597-111672ca8cc6 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:52.397032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-eb1660e8-9af1-4a93-b597-111672ca8cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:52.463031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1660e8-9af1-4a93-b597-111672ca8cc6 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:52.466693 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a306b-cb2e-455c-ad27-f93a9fd169ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:52.467285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a306b-cb2e-455c-ad27-f93a9fd169ef service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:52.467562 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a306b-cb2e-455c-ad27-f93a9fd169ef service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:52.467829 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a306b-cb2e-455c-ad27-f93a9fd169ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:52.469770 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6d7a306b-cb2e-455c-ad27-f93a9fd169ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:52.546775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a306b-cb2e-455c-ad27-f93a9fd169ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:52.548212 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a306b-cb2e-455c-ad27-f93a9fd169ef service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:52.566428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1341/2690] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:11:52 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:39.652047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a27ede-6e39-4f3b-ad58-285e61994abf service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:39.653779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-29a27ede-6e39-4f3b-ad58-285e61994abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:39.722395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a27ede-6e39-4f3b-ad58-285e61994abf service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:39.728505 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627d2d1-ed48-4633-a09f-ca92bd0ee7ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:39.729160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627d2d1-ed48-4633-a09f-ca92bd0ee7ff service placement] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:39.729444 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627d2d1-ed48-4633-a09f-ca92bd0ee7ff service placement] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:39.729723 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627d2d1-ed48-4633-a09f-ca92bd0ee7ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:39.731601 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c627d2d1-ed48-4633-a09f-ca92bd0ee7ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:39.743004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627d2d1-ed48-4633-a09f-ca92bd0ee7ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:39.744625 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627d2d1-ed48-4633-a09f-ca92bd0ee7ff service placement] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:39.754377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1350/2691] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:12:39 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:54.762695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a306b-cb2e-455c-ad27-f93a9fd169ef service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:54.764385 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-6d7a306b-cb2e-455c-ad27-f93a9fd169ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:54.808973 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a306b-cb2e-455c-ad27-f93a9fd169ef service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:54.815594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b310b54-9dc0-423b-a7d5-9e71ad22410f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:54.816277 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b310b54-9dc0-423b-a7d5-9e71ad22410f service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:54.816593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b310b54-9dc0-423b-a7d5-9e71ad22410f service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:54.816874 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b310b54-9dc0-423b-a7d5-9e71ad22410f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:54.826241 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b310b54-9dc0-423b-a7d5-9e71ad22410f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:54.827874 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b310b54-9dc0-423b-a7d5-9e71ad22410f service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:54.837722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1342/2692] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:12:54 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:16:10.212328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627d2d1-ed48-4633-a09f-ca92bd0ee7ff service placement] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:10.267856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627d2d1-ed48-4633-a09f-ca92bd0ee7ff service placement] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:10.271628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de7dd0-c654-4eeb-b73f-9445f378e49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:10.272272 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de7dd0-c654-4eeb-b73f-9445f378e49c service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:10.272655 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de7dd0-c654-4eeb-b73f-9445f378e49c service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:10.272933 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de7dd0-c654-4eeb-b73f-9445f378e49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:10.274701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-05de7dd0-c654-4eeb-b73f-9445f378e49c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:10.357112 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de7dd0-c654-4eeb-b73f-9445f378e49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:10.358558 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de7dd0-c654-4eeb-b73f-9445f378e49c service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:10.377194 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1351/2693] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:16:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:16:18.065747 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b310b54-9dc0-423b-a7d5-9e71ad22410f service nova] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:18.067360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8b310b54-9dc0-423b-a7d5-9e71ad22410f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:18.082516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b310b54-9dc0-423b-a7d5-9e71ad22410f service nova] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:18.087697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:18.088590 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:18.088875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:18.089243 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] PATH_INFO: `/v3/users/541c688efdf8455c9a083ca11f2678be` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:18.090703 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] RBAC: Authorizing `identity:delete_user(user_id=541c688efdf8455c9a083ca11f2678be)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:18.092759 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:18.290160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '541c688efdf8455c9a083ca11f2678be'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:18.301410 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '541c688efdf8455c9a083ca11f2678be'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:18.302078 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '541c688efdf8455c9a083ca11f2678be'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:18.308718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '541c688efdf8455c9a083ca11f2678be'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:18.375695 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '541c688efdf8455c9a083ca11f2678be'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:18.382391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1343/2694] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:16:18 2021] DELETE /identity/v3/users/541c688efdf8455c9a083ca11f2678be => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:16:18.641203 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de7dd0-c654-4eeb-b73f-9445f378e49c service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:18.651428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de7dd0-c654-4eeb-b73f-9445f378e49c service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:18.708662 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:18.709514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:18.709884 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:18.710161 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] PATH_INFO: `/v3/projects/92b52bac76904561ad7afe6ed672e999` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:18.711328 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b52bac76904561ad7afe6ed672e999)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:18.713317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:18.870575 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b52bac76904561ad7afe6ed672e999', 'request_id': 'req-3d51d018-9b6c-41b7-848a-7a427fdb4728'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:18.941758 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b52bac76904561ad7afe6ed672e999', 'request_id': 'req-3d51d018-9b6c-41b7-848a-7a427fdb4728'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:18.948159 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b52bac76904561ad7afe6ed672e999', 'request_id': 'req-3d51d018-9b6c-41b7-848a-7a427fdb4728'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:18.959808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] The token cache is being invalidate because project 92b52bac76904561ad7afe6ed672e999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:16:18.960099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:18.960801 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:18.962447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1352/2695] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:16:18 2021] DELETE /identity/v3/projects/92b52bac76904561ad7afe6ed672e999 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:16:18.966725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:18.968130 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:18.981956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef10ea-d70e-4fef-b7dd-da2dba03baea admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:19.036303 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:19.037236 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:19.037521 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:19.037800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] PATH_INFO: `/v3/users/ead952b423654531ac06e9ddb3c693b3` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:19.051233 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead952b423654531ac06e9ddb3c693b3)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:19.053195 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:19.291213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead952b423654531ac06e9ddb3c693b3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:19.302518 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead952b423654531ac06e9ddb3c693b3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:19.303184 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead952b423654531ac06e9ddb3c693b3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:19.309816 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead952b423654531ac06e9ddb3c693b3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:19.391644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead952b423654531ac06e9ddb3c693b3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:19.397766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1344/2696] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:16:18 2021] DELETE /identity/v3/users/ead952b423654531ac06e9ddb3c693b3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:16:19.680114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:19.685544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:19.700613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51d018-9b6c-41b7-848a-7a427fdb4728 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:19.755317 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:19.756169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:19.756486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:19.756767 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] PATH_INFO: `/v3/projects/ae4d88312e7842e784da531b68ab996c` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:19.767779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4d88312e7842e784da531b68ab996c)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:19.773358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:19.929672 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4d88312e7842e784da531b68ab996c', 'request_id': 'req-4c888427-5b7e-4de4-8dd7-ea2fe0516711'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:19.998794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4d88312e7842e784da531b68ab996c', 'request_id': 'req-4c888427-5b7e-4de4-8dd7-ea2fe0516711'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:20.004727 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4d88312e7842e784da531b68ab996c', 'request_id': 'req-4c888427-5b7e-4de4-8dd7-ea2fe0516711'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:20.016812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] The token cache is being invalidate because project ae4d88312e7842e784da531b68ab996c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:16:20.017103 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:20.017739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:20.019279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1353/2697] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:16:19 2021] DELETE /identity/v3/projects/ae4d88312e7842e784da531b68ab996c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:16:43.952445 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:43.953900 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:44.024928 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6263c1-73c5-4ded-8460-825b3a2d750d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:44.070565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628702a6-8556-4fd5-b9d3-858e6f22b1bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:44.071212 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628702a6-8556-4fd5-b9d3-858e6f22b1bf service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:44.071498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628702a6-8556-4fd5-b9d3-858e6f22b1bf service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:44.071781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628702a6-8556-4fd5-b9d3-858e6f22b1bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:44.073558 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-628702a6-8556-4fd5-b9d3-858e6f22b1bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:44.082625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628702a6-8556-4fd5-b9d3-858e6f22b1bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:44.084058 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628702a6-8556-4fd5-b9d3-858e6f22b1bf service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:44.092593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1345/2698] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:16:43 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:16:51.658278 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:51.659780 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:51.716119 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c888427-5b7e-4de4-8dd7-ea2fe0516711 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:51.720515 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97cea1-abf2-473d-be1e-142543234f64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:51.721166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97cea1-abf2-473d-be1e-142543234f64 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:51.721450 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97cea1-abf2-473d-be1e-142543234f64 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:51.721774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97cea1-abf2-473d-be1e-142543234f64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:51.723741 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-2d97cea1-abf2-473d-be1e-142543234f64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:51.804360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97cea1-abf2-473d-be1e-142543234f64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:51.805819 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97cea1-abf2-473d-be1e-142543234f64 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:51.824093 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1354/2699] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:16:51 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:17:44.628763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628702a6-8556-4fd5-b9d3-858e6f22b1bf service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:44.630157 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-628702a6-8556-4fd5-b9d3-858e6f22b1bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:44.758258 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628702a6-8556-4fd5-b9d3-858e6f22b1bf service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:44.763517 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5b033-210e-4165-8c79-4f4216a45636 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:44.764170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5b033-210e-4165-8c79-4f4216a45636 service placement] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:44.764531 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5b033-210e-4165-8c79-4f4216a45636 service placement] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:44.764809 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5b033-210e-4165-8c79-4f4216a45636 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:44.766572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-19f5b033-210e-4165-8c79-4f4216a45636 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:44.778557 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5b033-210e-4165-8c79-4f4216a45636 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:44.780125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5b033-210e-4165-8c79-4f4216a45636 service placement] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:44.789890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1346/2700] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:17:44 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:17:55.545478 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97cea1-abf2-473d-be1e-142543234f64 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:55.572761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97cea1-abf2-473d-be1e-142543234f64 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:55.576287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406d831-7636-41f6-bef7-6d20c5c27c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:55.576937 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406d831-7636-41f6-bef7-6d20c5c27c45 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:55.577221 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406d831-7636-41f6-bef7-6d20c5c27c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:55.577492 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406d831-7636-41f6-bef7-6d20c5c27c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:55.579227 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1406d831-7636-41f6-bef7-6d20c5c27c45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:55.655378 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406d831-7636-41f6-bef7-6d20c5c27c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:55.656834 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406d831-7636-41f6-bef7-6d20c5c27c45 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:55.674107 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1355/2701] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:17:55 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:21:47.349352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5b033-210e-4165-8c79-4f4216a45636 service placement] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:21:47.350703 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-19f5b033-210e-4165-8c79-4f4216a45636 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:21:47.381293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5b033-210e-4165-8c79-4f4216a45636 service placement] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:21:47.384945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c793c-ca10-4e56-bac8-28b98dff8105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:21:47.385582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c793c-ca10-4e56-bac8-28b98dff8105 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:21:47.385869 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c793c-ca10-4e56-bac8-28b98dff8105 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:21:47.386149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c793c-ca10-4e56-bac8-28b98dff8105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:21:47.393218 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c793c-ca10-4e56-bac8-28b98dff8105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:21:47.394628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c793c-ca10-4e56-bac8-28b98dff8105 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:21:47.402399 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1347/2702] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:21:47 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:21:52.348381 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406d831-7636-41f6-bef7-6d20c5c27c45 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:21:52.356736 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406d831-7636-41f6-bef7-6d20c5c27c45 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:21:52.360282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce2d67-17d6-46e4-9ac7-cb4cf1029bd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:21:52.360934 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2d67-17d6-46e4-9ac7-cb4cf1029bd4 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:21:52.361213 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2d67-17d6-46e4-9ac7-cb4cf1029bd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:21:52.361485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2d67-17d6-46e4-9ac7-cb4cf1029bd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:21:52.369405 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce2d67-17d6-46e4-9ac7-cb4cf1029bd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:21:52.370824 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce2d67-17d6-46e4-9ac7-cb4cf1029bd4 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:21:52.379266 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1356/2703] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:21:52 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:22:50.209646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c793c-ca10-4e56-bac8-28b98dff8105 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:22:50.211115 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c32c793c-ca10-4e56-bac8-28b98dff8105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:22:50.225793 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c793c-ca10-4e56-bac8-28b98dff8105 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:22:50.230742 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656a31e-380b-4643-9add-f427fb213ac9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:22:50.231376 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656a31e-380b-4643-9add-f427fb213ac9 service placement] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:22:50.231663 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656a31e-380b-4643-9add-f427fb213ac9 service placement] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:22:50.231944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656a31e-380b-4643-9add-f427fb213ac9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:22:50.240875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656a31e-380b-4643-9add-f427fb213ac9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:22:50.242435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656a31e-380b-4643-9add-f427fb213ac9 service placement] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:22:50.252743 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1348/2704] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:22:50 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:22:55.270253 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce2d67-17d6-46e4-9ac7-cb4cf1029bd4 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:22:55.271648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-85ce2d67-17d6-46e4-9ac7-cb4cf1029bd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:22:55.294739 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce2d67-17d6-46e4-9ac7-cb4cf1029bd4 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:22:55.298606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7fa86-02c6-4788-a5ee-33510ef089e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:22:55.299247 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7fa86-02c6-4788-a5ee-33510ef089e1 service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:22:55.299536 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7fa86-02c6-4788-a5ee-33510ef089e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:22:55.299798 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7fa86-02c6-4788-a5ee-33510ef089e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:22:55.308094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7fa86-02c6-4788-a5ee-33510ef089e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:22:55.309553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7fa86-02c6-4788-a5ee-33510ef089e1 service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:22:55.318069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1357/2705] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:22:55 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:23:34.725192 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656a31e-380b-4643-9add-f427fb213ac9 service placement] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:34.734139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656a31e-380b-4643-9add-f427fb213ac9 service placement] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:34.738185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae68ba-ddea-493f-b435-f4d1cfc542e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:34.738806 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae68ba-ddea-493f-b435-f4d1cfc542e7 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:34.739083 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae68ba-ddea-493f-b435-f4d1cfc542e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:34.739354 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae68ba-ddea-493f-b435-f4d1cfc542e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:34.741093 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-86ae68ba-ddea-493f-b435-f4d1cfc542e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:34.825270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae68ba-ddea-493f-b435-f4d1cfc542e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:34.826689 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae68ba-ddea-493f-b435-f4d1cfc542e7 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:34.845958 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1349/2706] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:23:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:23:36.021473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7fa86-02c6-4788-a5ee-33510ef089e1 service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:36.022890 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0ce7fa86-02c6-4788-a5ee-33510ef089e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:36.034358 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7fa86-02c6-4788-a5ee-33510ef089e1 service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:36.037895 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a6607-c422-4d75-a384-1bde4315804d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:36.038521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6607-c422-4d75-a384-1bde4315804d service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:36.038802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6607-c422-4d75-a384-1bde4315804d service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:36.039079 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6607-c422-4d75-a384-1bde4315804d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:36.040803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a89a6607-c422-4d75-a384-1bde4315804d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:36.053429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a6607-c422-4d75-a384-1bde4315804d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:36.054837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a6607-c422-4d75-a384-1bde4315804d service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:36.065910 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1358/2707] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:23:36 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:23:38.341315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae68ba-ddea-493f-b435-f4d1cfc542e7 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:38.348496 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-86ae68ba-ddea-493f-b435-f4d1cfc542e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:38.358198 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae68ba-ddea-493f-b435-f4d1cfc542e7 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:38.364270 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfd73b-6601-46a6-92e6-8fe0a0333169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:38.364969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd73b-6601-46a6-92e6-8fe0a0333169 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:38.365380 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd73b-6601-46a6-92e6-8fe0a0333169 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:38.365670 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd73b-6601-46a6-92e6-8fe0a0333169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:38.367585 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-08bfd73b-6601-46a6-92e6-8fe0a0333169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:38.382775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfd73b-6601-46a6-92e6-8fe0a0333169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:38.382775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfd73b-6601-46a6-92e6-8fe0a0333169 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:38.401002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1350/2708] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:23:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:23:45.831301 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a6607-c422-4d75-a384-1bde4315804d service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:45.840084 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a6607-c422-4d75-a384-1bde4315804d service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:45.843700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1c6d2-44fb-4206-8652-395e05631928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:45.844336 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1c6d2-44fb-4206-8652-395e05631928 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:45.844649 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1c6d2-44fb-4206-8652-395e05631928 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:45.844927 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1c6d2-44fb-4206-8652-395e05631928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:45.847146 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-61a1c6d2-44fb-4206-8652-395e05631928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:45.905847 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1c6d2-44fb-4206-8652-395e05631928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:45.907295 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1c6d2-44fb-4206-8652-395e05631928 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:45.917023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1359/2709] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:23:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:23:49.601502 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfd73b-6601-46a6-92e6-8fe0a0333169 service nova] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:49.603234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-08bfd73b-6601-46a6-92e6-8fe0a0333169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:49.616655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfd73b-6601-46a6-92e6-8fe0a0333169 service nova] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:49.621155 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:49.622017 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:49.622303 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:49.622744 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] PATH_INFO: `/v3/users/ffd9f61944414b4f886413ad331d4378` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:49.623876 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd9f61944414b4f886413ad331d4378)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:49.625875 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:49.757864 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd9f61944414b4f886413ad331d4378'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:23:49.769336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd9f61944414b4f886413ad331d4378'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:23:49.770114 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd9f61944414b4f886413ad331d4378'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:23:49.776882 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd9f61944414b4f886413ad331d4378'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:23:49.830830 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-4b095c1b-9849-4c84-badd-abf364cfc08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd9f61944414b4f886413ad331d4378'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:23:49.836801 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1351/2710] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:23:49 2021] DELETE /identity/v3/users/ffd9f61944414b4f886413ad331d4378 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:23:50.092465 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1c6d2-44fb-4206-8652-395e05631928 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:50.101779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1c6d2-44fb-4206-8652-395e05631928 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:50.166165 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:50.167100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:50.167378 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:50.167648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] PATH_INFO: `/v3/projects/d64a0028b26d4857b0daf241b29ee95b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:50.168897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64a0028b26d4857b0daf241b29ee95b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:50.170854 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:50.281412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64a0028b26d4857b0daf241b29ee95b', 'request_id': 'req-60a1247d-e521-420f-b5ef-78d7114be568'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:23:50.350569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64a0028b26d4857b0daf241b29ee95b', 'request_id': 'req-60a1247d-e521-420f-b5ef-78d7114be568'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:23:50.356004 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64a0028b26d4857b0daf241b29ee95b', 'request_id': 'req-60a1247d-e521-420f-b5ef-78d7114be568'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:23:50.367246 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] The token cache is being invalidate because project d64a0028b26d4857b0daf241b29ee95b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:23:50.367553 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:23:50.368151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-60a1247d-e521-420f-b5ef-78d7114be568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:23:50.369702 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1360/2711] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:23:50 2021] DELETE /identity/v3/projects/d64a0028b26d4857b0daf241b29ee95b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:23:50.375384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb1e46-f88f-4a33-8172-4ef8fb5ccd7c None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:50.375671 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb1e46-f88f-4a33-8172-4ef8fb5ccd7c None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:50.375945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb1e46-f88f-4a33-8172-4ef8fb5ccd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:50.429391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d4eb1e46-f88f-4a33-8172-4ef8fb5ccd7c None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:23:50.430593 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d4eb1e46-f88f-4a33-8172-4ef8fb5ccd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:50.491673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1352/2712] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:23:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:23:50.500023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbd9b5-9742-468c-a703-93808ddcf76b None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:50.518639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbd9b5-9742-468c-a703-93808ddcf76b None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:50.518639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbd9b5-9742-468c-a703-93808ddcf76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:50.518889 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c2bbd9b5-9742-468c-a703-93808ddcf76b None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:23:50.520008 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c2bbd9b5-9742-468c-a703-93808ddcf76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:50.527812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1361/2713] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:23:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:23:50.532273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb1e46-f88f-4a33-8172-4ef8fb5ccd7c None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:50.542566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb1e46-f88f-4a33-8172-4ef8fb5ccd7c None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:50.547218 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348e0f9-2b55-42b4-bff7-7a1add065e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:50.547863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348e0f9-2b55-42b4-bff7-7a1add065e3d admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:50.548193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348e0f9-2b55-42b4-bff7-7a1add065e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:50.548510 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348e0f9-2b55-42b4-bff7-7a1add065e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:50.549261 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348e0f9-2b55-42b4-bff7-7a1add065e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:23:50.549568 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348e0f9-2b55-42b4-bff7-7a1add065e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:50.551315 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348e0f9-2b55-42b4-bff7-7a1add065e3d admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:50.562377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1353/2714] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 05:23:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:23:50.566464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbd9b5-9742-468c-a703-93808ddcf76b None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:50.575637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbd9b5-9742-468c-a703-93808ddcf76b None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:50.580955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466d4ce-5e26-4f30-8498-6a79295501f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:50.582659 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d4ce-5e26-4f30-8498-6a79295501f6 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:50.582943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d4ce-5e26-4f30-8498-6a79295501f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:50.583219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d4ce-5e26-4f30-8498-6a79295501f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:50.583905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466d4ce-5e26-4f30-8498-6a79295501f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:50.585848 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466d4ce-5e26-4f30-8498-6a79295501f6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:50.670214 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1362/2715] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 05:23:50 2021] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:23:50.674060 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348e0f9-2b55-42b4-bff7-7a1add065e3d admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:50.684050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348e0f9-2b55-42b4-bff7-7a1add065e3d admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:50.738901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f4722-6c99-49dc-84a7-b99b78a1c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:50.739698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f4722-6c99-49dc-84a7-b99b78a1c2dc admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:50.740009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f4722-6c99-49dc-84a7-b99b78a1c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:50.740282 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f4722-6c99-49dc-84a7-b99b78a1c2dc admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:50.741014 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f4722-6c99-49dc-84a7-b99b78a1c2dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:50.742988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f4722-6c99-49dc-84a7-b99b78a1c2dc admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:50.851851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1354/2716] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 05:23:50 2021] POST /identity/v3/users => generated 278 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:23:50.855928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466d4ce-5e26-4f30-8498-6a79295501f6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:50.866187 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466d4ce-5e26-4f30-8498-6a79295501f6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:50.871094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b36962-375c-412a-8ca3-a55705b6c711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:50.871778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36962-375c-412a-8ca3-a55705b6c711 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:50.872064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36962-375c-412a-8ca3-a55705b6c711 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:50.872372 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36962-375c-412a-8ca3-a55705b6c711 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:50.873100 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b36962-375c-412a-8ca3-a55705b6c711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:50.874827 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b36962-375c-412a-8ca3-a55705b6c711 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:50.885160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1363/2717] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:23:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:23:50.888723 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f4722-6c99-49dc-84a7-b99b78a1c2dc admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:50.898963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f4722-6c99-49dc-84a7-b99b78a1c2dc admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:50.903606 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3914e0-0324-4421-b776-d1a52411df52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:50.904251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3914e0-0324-4421-b776-d1a52411df52 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:50.904572 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3914e0-0324-4421-b776-d1a52411df52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:50.904851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3914e0-0324-4421-b776-d1a52411df52 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:50.905564 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3914e0-0324-4421-b776-d1a52411df52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:50.907149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3914e0-0324-4421-b776-d1a52411df52 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:50.916960 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1355/2718] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:23:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:23:50.920737 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b36962-375c-412a-8ca3-a55705b6c711 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:50.930254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b36962-375c-412a-8ca3-a55705b6c711 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:50.934802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff464-f509-46a2-ad2c-a02a0d14cba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:50.935647 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff464-f509-46a2-ad2c-a02a0d14cba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:50.935928 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff464-f509-46a2-ad2c-a02a0d14cba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:50.936204 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff464-f509-46a2-ad2c-a02a0d14cba0 admin admin] PATH_INFO: `/v3/projects/883f948b790d44f98c697964c551c45b/users/5113d470976d4adab021643f75b1b84b/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:50.950916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aff464-f509-46a2-ad2c-a02a0d14cba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883f948b790d44f98c697964c551c45b, user_id=5113d470976d4adab021643f75b1b84b, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:50.953606 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aff464-f509-46a2-ad2c-a02a0d14cba0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:51.059366 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1364/2719] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:23:50 2021] PUT /identity/v3/projects/883f948b790d44f98c697964c551c45b/users/5113d470976d4adab021643f75b1b84b/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:23:51.069845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246d723-0925-4839-a815-b25f67c12327 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:51.070139 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246d723-0925-4839-a815-b25f67c12327 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:51.070420 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246d723-0925-4839-a815-b25f67c12327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:51.096591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-d246d723-0925-4839-a815-b25f67c12327 None None] MFA Rules not processed for user `5113d470976d4adab021643f75b1b84b`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:23:51.097796 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-d246d723-0925-4839-a815-b25f67c12327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:51.159681 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1356/2720] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:23:51 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:23:51.164065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff464-f509-46a2-ad2c-a02a0d14cba0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:51.222648 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff464-f509-46a2-ad2c-a02a0d14cba0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:51.227321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f9775-0594-4640-bd3f-908a7a2d45da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:51.227970 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9775-0594-4640-bd3f-908a7a2d45da admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:51.228256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9775-0594-4640-bd3f-908a7a2d45da admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:51.228624 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9775-0594-4640-bd3f-908a7a2d45da admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:51.229315 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f9775-0594-4640-bd3f-908a7a2d45da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:51.231212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f9775-0594-4640-bd3f-908a7a2d45da admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:51.364220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1365/2721] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 05:23:51 2021] POST /identity/v3/projects => generated 357 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:23:51.368156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246d723-0925-4839-a815-b25f67c12327 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:51.379326 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246d723-0925-4839-a815-b25f67c12327 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:51.434608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d9d14-7227-487e-953e-1e2c9de21a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:51.435276 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d9d14-7227-487e-953e-1e2c9de21a5b admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:51.435561 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d9d14-7227-487e-953e-1e2c9de21a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:51.435836 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d9d14-7227-487e-953e-1e2c9de21a5b admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:51.436541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d9d14-7227-487e-953e-1e2c9de21a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:51.438471 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d9d14-7227-487e-953e-1e2c9de21a5b admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:51.510141 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1357/2722] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 05:23:51 2021] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:23:51.514068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f9775-0594-4640-bd3f-908a7a2d45da admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:51.524190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f9775-0594-4640-bd3f-908a7a2d45da admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:51.528853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe37f-2758-4661-b7c5-3b81a27ab923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:51.529589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe37f-2758-4661-b7c5-3b81a27ab923 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:51.529905 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe37f-2758-4661-b7c5-3b81a27ab923 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:51.530178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe37f-2758-4661-b7c5-3b81a27ab923 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:51.530896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe37f-2758-4661-b7c5-3b81a27ab923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:51.532517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe37f-2758-4661-b7c5-3b81a27ab923 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:51.543007 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1366/2723] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:23:51 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:23:51.546835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d9d14-7227-487e-953e-1e2c9de21a5b admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:51.557110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d9d14-7227-487e-953e-1e2c9de21a5b admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:51.561825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4abb8-9cd6-4299-9ec8-baadf6ee0915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:51.562719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4abb8-9cd6-4299-9ec8-baadf6ee0915 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:51.563000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4abb8-9cd6-4299-9ec8-baadf6ee0915 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:51.563271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4abb8-9cd6-4299-9ec8-baadf6ee0915 admin admin] PATH_INFO: `/v3/projects/d252f3dfcea64f129a48864a175d2c44/users/3acf3ec4d0bf4b4aad7bfd05870b3a50/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:51.578569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4abb8-9cd6-4299-9ec8-baadf6ee0915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d252f3dfcea64f129a48864a175d2c44, user_id=3acf3ec4d0bf4b4aad7bfd05870b3a50, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:51.581304 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4abb8-9cd6-4299-9ec8-baadf6ee0915 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:51.693374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1358/2724] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:23:51 2021] PUT /identity/v3/projects/d252f3dfcea64f129a48864a175d2c44/users/3acf3ec4d0bf4b4aad7bfd05870b3a50/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:23:51.697407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe37f-2758-4661-b7c5-3b81a27ab923 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:51.707857 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe37f-2758-4661-b7c5-3b81a27ab923 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:51.762506 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdeafe-fad6-4297-a75f-4a3e4b8a2b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:51.763162 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdeafe-fad6-4297-a75f-4a3e4b8a2b6a admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:51.763447 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdeafe-fad6-4297-a75f-4a3e4b8a2b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:51.763722 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdeafe-fad6-4297-a75f-4a3e4b8a2b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:51.764464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdeafe-fad6-4297-a75f-4a3e4b8a2b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:51.766068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdeafe-fad6-4297-a75f-4a3e4b8a2b6a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:51.775969 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1367/2725] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:23:51 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:23:51.780134 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4abb8-9cd6-4299-9ec8-baadf6ee0915 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:51.790321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4abb8-9cd6-4299-9ec8-baadf6ee0915 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:51.794932 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029dc0-e429-4134-b964-e1dfeb35a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:51.795803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029dc0-e429-4134-b964-e1dfeb35a414 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:51.796084 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029dc0-e429-4134-b964-e1dfeb35a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:51.796369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029dc0-e429-4134-b964-e1dfeb35a414 admin admin] PATH_INFO: `/v3/projects/d252f3dfcea64f129a48864a175d2c44/users/3acf3ec4d0bf4b4aad7bfd05870b3a50/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:51.798329 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31029dc0-e429-4134-b964-e1dfeb35a414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d252f3dfcea64f129a48864a175d2c44, user_id=3acf3ec4d0bf4b4aad7bfd05870b3a50, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:51.801033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31029dc0-e429-4134-b964-e1dfeb35a414 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:51.810956 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1359/2726] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:23:51 2021] PUT /identity/v3/projects/d252f3dfcea64f129a48864a175d2c44/users/3acf3ec4d0bf4b4aad7bfd05870b3a50/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:23:51.821207 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6a97-5381-4d09-b8a6-ed3d4220669a None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:51.821522 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6a97-5381-4d09-b8a6-ed3d4220669a None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:51.821803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6a97-5381-4d09-b8a6-ed3d4220669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:51.848275 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-0f1a6a97-5381-4d09-b8a6-ed3d4220669a None None] MFA Rules not processed for user `3acf3ec4d0bf4b4aad7bfd05870b3a50`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:23:51.849486 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-0f1a6a97-5381-4d09-b8a6-ed3d4220669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:51.913778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1368/2727] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:23:51 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:23:51.925015 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029dc0-e429-4134-b964-e1dfeb35a414 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:51.926761 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-31029dc0-e429-4134-b964-e1dfeb35a414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:23:51.981698 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029dc0-e429-4134-b964-e1dfeb35a414 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:51.985367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bc282-e0ac-44c4-99e0-edb5a2dedad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:51.985998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bc282-e0ac-44c4-99e0-edb5a2dedad9 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:51.986281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bc282-e0ac-44c4-99e0-edb5a2dedad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:51.987057 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bc282-e0ac-44c4-99e0-edb5a2dedad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:51.995890 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bc282-e0ac-44c4-99e0-edb5a2dedad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:51.997345 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bc282-e0ac-44c4-99e0-edb5a2dedad9 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:52.007213 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1360/2728] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:23:51 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:23:52.271217 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a6a97-5381-4d09-b8a6-ed3d4220669a None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:52.280570 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a6a97-5381-4d09-b8a6-ed3d4220669a None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:52.284129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9f6db-e8b0-4666-9158-9537df79d59b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:52.284782 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9f6db-e8b0-4666-9158-9537df79d59b service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:52.285064 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9f6db-e8b0-4666-9158-9537df79d59b service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:52.285337 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9f6db-e8b0-4666-9158-9537df79d59b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:52.340429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9f6db-e8b0-4666-9158-9537df79d59b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:52.343610 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9f6db-e8b0-4666-9158-9537df79d59b service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:52.351424 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1369/2729] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:23:52 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:04.891347 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bc282-e0ac-44c4-99e0-edb5a2dedad9 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:04.892968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-336bc282-e0ac-44c4-99e0-edb5a2dedad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:04.952803 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bc282-e0ac-44c4-99e0-edb5a2dedad9 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:04.956293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de129-2927-476d-9897-94426a464b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:04.956965 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de129-2927-476d-9897-94426a464b4c service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:04.957251 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de129-2927-476d-9897-94426a464b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:04.957530 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de129-2927-476d-9897-94426a464b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:04.959353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-3f4de129-2927-476d-9897-94426a464b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:05.026224 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4de129-2927-476d-9897-94426a464b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:05.027687 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4de129-2927-476d-9897-94426a464b4c service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:05.037183 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1361/2730] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:05.703099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9f6db-e8b0-4666-9158-9537df79d59b service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:05.705044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-1cb9f6db-e8b0-4666-9158-9537df79d59b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:05.722155 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9f6db-e8b0-4666-9158-9537df79d59b service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:05.728986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:05.728986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:05.728986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:05.728986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] PATH_INFO: `/v3/users/dc40b5a2420e4b45804f00bcb82312c7` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:05.729539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc40b5a2420e4b45804f00bcb82312c7)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:05.731544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:05.980072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc40b5a2420e4b45804f00bcb82312c7'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:05.980676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc40b5a2420e4b45804f00bcb82312c7'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:05.981334 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc40b5a2420e4b45804f00bcb82312c7'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:05.993013 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc40b5a2420e4b45804f00bcb82312c7'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:06.125766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-e73fc72f-e36d-486d-9568-5ae772e119c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc40b5a2420e4b45804f00bcb82312c7'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:06.139587 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1370/2731] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:24:05 2021] DELETE /identity/v3/users/dc40b5a2420e4b45804f00bcb82312c7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:06.380302 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de129-2927-476d-9897-94426a464b4c service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:06.392088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de129-2927-476d-9897-94426a464b4c service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:06.448773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:06.449625 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:06.449907 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:06.450181 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] PATH_INFO: `/v3/projects/fa9bf6413b134bb38daf4ef2cdebc5b5` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:06.451341 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9bf6413b134bb38daf4ef2cdebc5b5)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:06.453264 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:06.583910 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9bf6413b134bb38daf4ef2cdebc5b5', 'request_id': 'req-389c209c-a336-486e-ab21-8c7fcb28f1c4'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:06.590055 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9bf6413b134bb38daf4ef2cdebc5b5', 'request_id': 'req-389c209c-a336-486e-ab21-8c7fcb28f1c4'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:06.595472 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9bf6413b134bb38daf4ef2cdebc5b5', 'request_id': 'req-389c209c-a336-486e-ab21-8c7fcb28f1c4'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:06.685646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] The token cache is being invalidate because project fa9bf6413b134bb38daf4ef2cdebc5b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:24:06.685941 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:06.686543 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-389c209c-a336-486e-ab21-8c7fcb28f1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:06.688062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1362/2732] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:24:06 2021] DELETE /identity/v3/projects/fa9bf6413b134bb38daf4ef2cdebc5b5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:06.695982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e7db-3694-41ee-9b56-301850b1c988 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:06.699391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e7db-3694-41ee-9b56-301850b1c988 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:06.699391 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e7db-3694-41ee-9b56-301850b1c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:06.716761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-a9a3e7db-3694-41ee-9b56-301850b1c988 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:06.717944 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a9a3e7db-3694-41ee-9b56-301850b1c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:06.773448 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1371/2733] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:24:06.780982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc243438-1be6-4483-b1a4-7108275623d2 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:06.781266 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc243438-1be6-4483-b1a4-7108275623d2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:06.781541 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc243438-1be6-4483-b1a4-7108275623d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:06.799499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-cc243438-1be6-4483-b1a4-7108275623d2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:06.800712 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-cc243438-1be6-4483-b1a4-7108275623d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:06.809379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1363/2734] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:06.813419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3e7db-3694-41ee-9b56-301850b1c988 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:06.823219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3e7db-3694-41ee-9b56-301850b1c988 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:06.827769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cccefa-8eed-4d92-84ae-65c50daef4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:06.828446 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cccefa-8eed-4d92-84ae-65c50daef4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:06.828733 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cccefa-8eed-4d92-84ae-65c50daef4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:06.829009 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cccefa-8eed-4d92-84ae-65c50daef4a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:06.829732 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cccefa-8eed-4d92-84ae-65c50daef4a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:24:06.830039 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cccefa-8eed-4d92-84ae-65c50daef4a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:06.831632 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cccefa-8eed-4d92-84ae-65c50daef4a0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:06.843395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1372/2735] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 05:24:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:24:06.847773 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc243438-1be6-4483-b1a4-7108275623d2 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:06.857300 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc243438-1be6-4483-b1a4-7108275623d2 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:06.862032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de5051-4cb5-4113-95bc-014d8a526c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:06.862691 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5051-4cb5-4113-95bc-014d8a526c28 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:06.863048 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5051-4cb5-4113-95bc-014d8a526c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:06.863210 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5051-4cb5-4113-95bc-014d8a526c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:06.863886 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de5051-4cb5-4113-95bc-014d8a526c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:06.865798 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de5051-4cb5-4113-95bc-014d8a526c28 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:07.005008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1364/2736] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 05:24:06 2021] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:24:07.006144 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cccefa-8eed-4d92-84ae-65c50daef4a0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:07.016190 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cccefa-8eed-4d92-84ae-65c50daef4a0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:07.070705 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72526f4f-d182-4d1f-ae83-bda0bc394e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:07.071377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72526f4f-d182-4d1f-ae83-bda0bc394e68 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:07.071660 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72526f4f-d182-4d1f-ae83-bda0bc394e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:07.072189 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72526f4f-d182-4d1f-ae83-bda0bc394e68 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:07.072931 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72526f4f-d182-4d1f-ae83-bda0bc394e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:07.074920 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72526f4f-d182-4d1f-ae83-bda0bc394e68 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:07.237377 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1373/2737] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 05:24:07 2021] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:24:07.242384 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de5051-4cb5-4113-95bc-014d8a526c28 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:07.252723 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de5051-4cb5-4113-95bc-014d8a526c28 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:07.257858 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e1ed-cac1-4c91-beba-801ab962a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:07.258513 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e1ed-cac1-4c91-beba-801ab962a5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:07.258799 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e1ed-cac1-4c91-beba-801ab962a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:07.259080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e1ed-cac1-4c91-beba-801ab962a5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:07.259800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68e1ed-cac1-4c91-beba-801ab962a5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:07.261448 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68e1ed-cac1-4c91-beba-801ab962a5f5 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:07.271839 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1365/2738] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:07.276413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72526f4f-d182-4d1f-ae83-bda0bc394e68 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:07.286410 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72526f4f-d182-4d1f-ae83-bda0bc394e68 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:07.291113 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76d283-bbb7-48c9-9d3f-9b910a8074b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:07.291766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76d283-bbb7-48c9-9d3f-9b910a8074b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:07.292048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76d283-bbb7-48c9-9d3f-9b910a8074b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:07.292329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76d283-bbb7-48c9-9d3f-9b910a8074b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:07.293075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76d283-bbb7-48c9-9d3f-9b910a8074b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:07.294676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76d283-bbb7-48c9-9d3f-9b910a8074b7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:07.304656 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1374/2739] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:07.308539 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e1ed-cac1-4c91-beba-801ab962a5f5 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:07.318498 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e1ed-cac1-4c91-beba-801ab962a5f5 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:07.323944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221389c8-c3aa-4eee-9420-97f5c8b241e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:07.324845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221389c8-c3aa-4eee-9420-97f5c8b241e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:07.325131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221389c8-c3aa-4eee-9420-97f5c8b241e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:07.325411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221389c8-c3aa-4eee-9420-97f5c8b241e2 admin admin] PATH_INFO: `/v3/projects/e871b7bc06b6412697156920cbc3f504/users/daa43240be34453a8090767848538c99/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:07.340131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221389c8-c3aa-4eee-9420-97f5c8b241e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e871b7bc06b6412697156920cbc3f504, user_id=daa43240be34453a8090767848538c99, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:07.342862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221389c8-c3aa-4eee-9420-97f5c8b241e2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:07.423846 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1366/2740] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:24:07 2021] PUT /identity/v3/projects/e871b7bc06b6412697156920cbc3f504/users/daa43240be34453a8090767848538c99/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:07.428877 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a37760-7882-4dad-a501-f3d8462a9af5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:07.429191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a37760-7882-4dad-a501-f3d8462a9af5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:07.429473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a37760-7882-4dad-a501-f3d8462a9af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:07.447402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-25a37760-7882-4dad-a501-f3d8462a9af5 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:07.448636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-25a37760-7882-4dad-a501-f3d8462a9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:07.503903 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1375/2741] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:24:07.514234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221389c8-c3aa-4eee-9420-97f5c8b241e2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:07.515929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-221389c8-c3aa-4eee-9420-97f5c8b241e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:07.571022 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221389c8-c3aa-4eee-9420-97f5c8b241e2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:07.574966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f787e1-c977-4f9b-8106-a28e26299b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:07.575602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f787e1-c977-4f9b-8106-a28e26299b70 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:07.575884 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f787e1-c977-4f9b-8106-a28e26299b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:07.576159 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f787e1-c977-4f9b-8106-a28e26299b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:07.584966 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f787e1-c977-4f9b-8106-a28e26299b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:07.586618 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f787e1-c977-4f9b-8106-a28e26299b70 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:07.596225 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1367/2742] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:10.381700 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a37760-7882-4dad-a501-f3d8462a9af5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:10.383277 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-25a37760-7882-4dad-a501-f3d8462a9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:10.395290 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a37760-7882-4dad-a501-f3d8462a9af5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:10.400321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:10.401254 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:10.401544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:10.401837 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] PATH_INFO: `/v3/users/5113d470976d4adab021643f75b1b84b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:10.403109 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5113d470976d4adab021643f75b1b84b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:10.405194 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:10.643630 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5113d470976d4adab021643f75b1b84b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:10.644574 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5113d470976d4adab021643f75b1b84b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:10.645395 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5113d470976d4adab021643f75b1b84b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:10.658909 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5113d470976d4adab021643f75b1b84b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:10.768297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5113d470976d4adab021643f75b1b84b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:10.790844 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf406-8c67-457c-ab69-833f062a18d4 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:10.791256 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf406-8c67-457c-ab69-833f062a18d4 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:10.791395 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf406-8c67-457c-ab69-833f062a18d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:10.797198 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1376/2743] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:24:10 2021] DELETE /identity/v3/users/5113d470976d4adab021643f75b1b84b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:10.815462 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ffdcf406-8c67-457c-ab69-833f062a18d4 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:10.816929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ffdcf406-8c67-457c-ab69-833f062a18d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:10.892331 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1368/2744] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:10.903925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:10.905387 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:10.962546 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a9676-0dec-406d-b8ec-0706da747ef0 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:10.966520 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e2b4b-1ed7-49df-85ae-073e6bcb5c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:10.967173 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e2b4b-1ed7-49df-85ae-073e6bcb5c29 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:10.967463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e2b4b-1ed7-49df-85ae-073e6bcb5c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:10.967756 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e2b4b-1ed7-49df-85ae-073e6bcb5c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:10.977899 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e2b4b-1ed7-49df-85ae-073e6bcb5c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:10.980257 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e2b4b-1ed7-49df-85ae-073e6bcb5c29 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:10.989883 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1377/2745] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:24:11.546207 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf406-8c67-457c-ab69-833f062a18d4 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:11.548167 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ffdcf406-8c67-457c-ab69-833f062a18d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:11.563069 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf406-8c67-457c-ab69-833f062a18d4 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:11.568497 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:11.569511 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:11.570753 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:11.571041 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] PATH_INFO: `/v3/projects/883f948b790d44f98c697964c551c45b` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:11.573031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=883f948b790d44f98c697964c551c45b)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:11.575269 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:11.672641 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883f948b790d44f98c697964c551c45b', 'request_id': 'req-cb7fc26d-cb61-4222-aaec-0c51fe683f82'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:11.679362 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883f948b790d44f98c697964c551c45b', 'request_id': 'req-cb7fc26d-cb61-4222-aaec-0c51fe683f82'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:11.688161 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883f948b790d44f98c697964c551c45b', 'request_id': 'req-cb7fc26d-cb61-4222-aaec-0c51fe683f82'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:11.806080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] The token cache is being invalidate because project 883f948b790d44f98c697964c551c45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:24:11.807169 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:11.807991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:11.812986 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1369/2746] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:24:11 2021] DELETE /identity/v3/projects/883f948b790d44f98c697964c551c45b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:11.814306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e2b4b-1ed7-49df-85ae-073e6bcb5c29 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:11.824488 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e2b4b-1ed7-49df-85ae-073e6bcb5c29 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:11.887803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:11.888896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:11.889195 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:11.889479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] PATH_INFO: `/v3/users/3acf3ec4d0bf4b4aad7bfd05870b3a50` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:11.890777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acf3ec4d0bf4b4aad7bfd05870b3a50)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:11.892774 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:12.129580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acf3ec4d0bf4b4aad7bfd05870b3a50'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:12.130516 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acf3ec4d0bf4b4aad7bfd05870b3a50'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:12.131291 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acf3ec4d0bf4b4aad7bfd05870b3a50'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:12.149893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acf3ec4d0bf4b4aad7bfd05870b3a50'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:12.266713 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-d56c3db4-b088-40ae-b5e8-1ede025bf397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acf3ec4d0bf4b4aad7bfd05870b3a50'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:12.296275 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1378/2747] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:24:11 2021] DELETE /identity/v3/users/3acf3ec4d0bf4b4aad7bfd05870b3a50 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:12.740428 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:12.742171 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:12.757597 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fc26d-cb61-4222-aaec-0c51fe683f82 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:12.816177 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:12.817088 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:12.817372 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:12.817652 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] PATH_INFO: `/v3/projects/d252f3dfcea64f129a48864a175d2c44` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:12.818855 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d252f3dfcea64f129a48864a175d2c44)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:12.821397 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:12.945569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd252f3dfcea64f129a48864a175d2c44', 'request_id': 'req-9442fb26-9381-461b-8b42-9de05f0aa107'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:12.952644 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd252f3dfcea64f129a48864a175d2c44', 'request_id': 'req-9442fb26-9381-461b-8b42-9de05f0aa107'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:12.958573 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd252f3dfcea64f129a48864a175d2c44', 'request_id': 'req-9442fb26-9381-461b-8b42-9de05f0aa107'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:13.063338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] The token cache is being invalidate because project d252f3dfcea64f129a48864a175d2c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:24:13.063640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:13.064594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-9442fb26-9381-461b-8b42-9de05f0aa107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:13.066817 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1370/2748] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:24:12 2021] DELETE /identity/v3/projects/d252f3dfcea64f129a48864a175d2c44 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:13.076678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c99cd0-79b2-4965-ac93-3a00308e4502 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.077564 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c99cd0-79b2-4965-ac93-3a00308e4502 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.078051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c99cd0-79b2-4965-ac93-3a00308e4502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.106021 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-e7c99cd0-79b2-4965-ac93-3a00308e4502 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:13.107538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-e7c99cd0-79b2-4965-ac93-3a00308e4502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:13.207388 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1379/2749] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:24:13.215268 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c324175-b6fc-4092-8851-38fe8cfae4ac None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.215560 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c324175-b6fc-4092-8851-38fe8cfae4ac None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.216013 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c324175-b6fc-4092-8851-38fe8cfae4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.239703 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-3c324175-b6fc-4092-8851-38fe8cfae4ac None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:13.242189 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-3c324175-b6fc-4092-8851-38fe8cfae4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:13.254583 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1371/2750] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:24:13.258573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c99cd0-79b2-4965-ac93-3a00308e4502 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:13.273711 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c99cd0-79b2-4965-ac93-3a00308e4502 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:13.279893 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b0ebc-7013-4ee1-906b-4f7a8a21af42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:13.280936 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0ebc-7013-4ee1-906b-4f7a8a21af42 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.281474 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0ebc-7013-4ee1-906b-4f7a8a21af42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.281828 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0ebc-7013-4ee1-906b-4f7a8a21af42 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.282679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b0ebc-7013-4ee1-906b-4f7a8a21af42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:24:13.283062 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b0ebc-7013-4ee1-906b-4f7a8a21af42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:13.286091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b0ebc-7013-4ee1-906b-4f7a8a21af42 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:13.303769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1380/2751] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 05:24:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:24:13.305666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c324175-b6fc-4092-8851-38fe8cfae4ac None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:13.316439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c324175-b6fc-4092-8851-38fe8cfae4ac None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:13.321903 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7769f62-bf8f-4e28-b1a9-1b6786197c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:13.323122 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7769f62-bf8f-4e28-b1a9-1b6786197c44 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.323413 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7769f62-bf8f-4e28-b1a9-1b6786197c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.323766 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7769f62-bf8f-4e28-b1a9-1b6786197c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.324584 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7769f62-bf8f-4e28-b1a9-1b6786197c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:13.326648 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7769f62-bf8f-4e28-b1a9-1b6786197c44 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:13.457499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1372/2752] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 05:24:13 2021] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:24:13.462556 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b0ebc-7013-4ee1-906b-4f7a8a21af42 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:13.473864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b0ebc-7013-4ee1-906b-4f7a8a21af42 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:13.542779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e5f82-c269-429a-957e-761a1a300368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:13.543491 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e5f82-c269-429a-957e-761a1a300368 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.543786 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e5f82-c269-429a-957e-761a1a300368 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.544050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e5f82-c269-429a-957e-761a1a300368 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.544778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e5f82-c269-429a-957e-761a1a300368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:13.546720 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e5f82-c269-429a-957e-761a1a300368 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:13.596254 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9907-6ab1-476b-aa06-dfb872e30b7a None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.596581 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9907-6ab1-476b-aa06-dfb872e30b7a None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.596863 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9907-6ab1-476b-aa06-dfb872e30b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.624743 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-235e9907-6ab1-476b-aa06-dfb872e30b7a None None] MFA Rules not processed for user `daa43240be34453a8090767848538c99`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:13.626030 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-235e9907-6ab1-476b-aa06-dfb872e30b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:13.688729 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1381/2753] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 05:24:13 2021] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:24:13.690054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e5f82-c269-429a-957e-761a1a300368 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:13.697728 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1373/2754] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:13 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:24:13.700555 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e5f82-c269-429a-957e-761a1a300368 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:13.701602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e9907-6ab1-476b-aa06-dfb872e30b7a None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:13.702934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-235e9907-6ab1-476b-aa06-dfb872e30b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:13.705296 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c8c91-0cf2-4d79-84ff-1989e5f3eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:13.705957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8c91-0cf2-4d79-84ff-1989e5f3eec3 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.706245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8c91-0cf2-4d79-84ff-1989e5f3eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.706526 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8c91-0cf2-4d79-84ff-1989e5f3eec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.707389 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c8c91-0cf2-4d79-84ff-1989e5f3eec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:13.709043 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c8c91-0cf2-4d79-84ff-1989e5f3eec3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:13.716748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e9907-6ab1-476b-aa06-dfb872e30b7a None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:13.719825 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1382/2755] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:24:13.722033 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087e871-34eb-4d9d-aa28-f97c69b8ed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:13.722694 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087e871-34eb-4d9d-aa28-f97c69b8ed69 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.722982 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087e871-34eb-4d9d-aa28-f97c69b8ed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.723262 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087e871-34eb-4d9d-aa28-f97c69b8ed69 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.723706 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c8c91-0cf2-4d79-84ff-1989e5f3eec3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:13.723949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087e871-34eb-4d9d-aa28-f97c69b8ed69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:13.726628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087e871-34eb-4d9d-aa28-f97c69b8ed69 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:13.734048 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c8c91-0cf2-4d79-84ff-1989e5f3eec3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:13.738636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0f298-716f-46bd-bd9f-42c1cb3e01d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:13.739274 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0f298-716f-46bd-bd9f-42c1cb3e01d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.739562 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0f298-716f-46bd-bd9f-42c1cb3e01d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.739841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0f298-716f-46bd-bd9f-42c1cb3e01d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.740584 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0f298-716f-46bd-bd9f-42c1cb3e01d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:13.742232 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0f298-716f-46bd-bd9f-42c1cb3e01d6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:13.752380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1383/2756] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:13.756259 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0f298-716f-46bd-bd9f-42c1cb3e01d6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:13.765428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0f298-716f-46bd-bd9f-42c1cb3e01d6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:13.769943 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbae25-0232-4711-8911-56681931f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:13.770788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbae25-0232-4711-8911-56681931f242 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.771051 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbae25-0232-4711-8911-56681931f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.771326 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbae25-0232-4711-8911-56681931f242 admin admin] PATH_INFO: `/v3/projects/e3f321798ab447eca9f938207d81539b/users/eee4709cf8c1417cb9f5aca0165561f9/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.786823 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbae25-0232-4711-8911-56681931f242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f321798ab447eca9f938207d81539b, user_id=eee4709cf8c1417cb9f5aca0165561f9, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:13.790115 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbae25-0232-4711-8911-56681931f242 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:13.808666 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1374/2757] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 05:24:13 2021] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:24:13.812611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087e871-34eb-4d9d-aa28-f97c69b8ed69 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:13.871351 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087e871-34eb-4d9d-aa28-f97c69b8ed69 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:13.876202 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3151dd2-0b6e-453c-b57e-fd877743cd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:13.876952 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3151dd2-0b6e-453c-b57e-fd877743cd16 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.877238 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3151dd2-0b6e-453c-b57e-fd877743cd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.877516 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3151dd2-0b6e-453c-b57e-fd877743cd16 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.878244 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3151dd2-0b6e-453c-b57e-fd877743cd16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:13.880223 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3151dd2-0b6e-453c-b57e-fd877743cd16 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:13.889714 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1384/2758] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:24:13 2021] PUT /identity/v3/projects/e3f321798ab447eca9f938207d81539b/users/eee4709cf8c1417cb9f5aca0165561f9/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:24:13.901900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610011f4-0b81-4118-9ea6-1c25ddf871c9 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:13.901900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610011f4-0b81-4118-9ea6-1c25ddf871c9 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:13.901900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610011f4-0b81-4118-9ea6-1c25ddf871c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:13.927403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-610011f4-0b81-4118-9ea6-1c25ddf871c9 None None] MFA Rules not processed for user `eee4709cf8c1417cb9f5aca0165561f9`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:13.928678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-610011f4-0b81-4118-9ea6-1c25ddf871c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:13.991750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1375/2759] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 05:24:13 2021] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:24:13.992873 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3151dd2-0b6e-453c-b57e-fd877743cd16 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:13.997468 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1385/2760] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:13 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:24:13.998365 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610011f4-0b81-4118-9ea6-1c25ddf871c9 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:14.002929 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3151dd2-0b6e-453c-b57e-fd877743cd16 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.056785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a18da5-5b6b-4fd7-9445-50eada6d65a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.057294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610011f4-0b81-4118-9ea6-1c25ddf871c9 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.057491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a18da5-5b6b-4fd7-9445-50eada6d65a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.057775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a18da5-5b6b-4fd7-9445-50eada6d65a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.058052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a18da5-5b6b-4fd7-9445-50eada6d65a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.058820 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a18da5-5b6b-4fd7-9445-50eada6d65a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:14.060462 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a18da5-5b6b-4fd7-9445-50eada6d65a6 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:14.062092 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd76c9-31d4-4d60-a601-1f633c2b66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.062751 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd76c9-31d4-4d60-a601-1f633c2b66e1 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.063035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd76c9-31d4-4d60-a601-1f633c2b66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.063311 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd76c9-31d4-4d60-a601-1f633c2b66e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.063997 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd76c9-31d4-4d60-a601-1f633c2b66e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:14.065925 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd76c9-31d4-4d60-a601-1f633c2b66e1 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:14.070576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1376/2761] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:13 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:14.074878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a18da5-5b6b-4fd7-9445-50eada6d65a6 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:14.085734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a18da5-5b6b-4fd7-9445-50eada6d65a6 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.090608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519748c3-32d6-4b54-bb76-d935150d6fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.091500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519748c3-32d6-4b54-bb76-d935150d6fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.091786 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519748c3-32d6-4b54-bb76-d935150d6fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.092436 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519748c3-32d6-4b54-bb76-d935150d6fdb admin admin] PATH_INFO: `/v3/projects/033575ce14db453dbce3078e9ce6e17a/users/f5548bbc932e4734a5c0dd34bb34ef27/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.108968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519748c3-32d6-4b54-bb76-d935150d6fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=033575ce14db453dbce3078e9ce6e17a, user_id=f5548bbc932e4734a5c0dd34bb34ef27, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:14.111637 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519748c3-32d6-4b54-bb76-d935150d6fdb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:14.146605 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1386/2762] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 05:24:13 2021] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:24:14.151463 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd76c9-31d4-4d60-a601-1f633c2b66e1 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:14.197442 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1377/2763] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:24:14 2021] PUT /identity/v3/projects/033575ce14db453dbce3078e9ce6e17a/users/f5548bbc932e4734a5c0dd34bb34ef27/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:14.201548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519748c3-32d6-4b54-bb76-d935150d6fdb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:14.218621 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd76c9-31d4-4d60-a601-1f633c2b66e1 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.273373 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519748c3-32d6-4b54-bb76-d935150d6fdb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.277628 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33782597-d79a-4fc5-879b-ebee0bcaec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.278325 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33782597-d79a-4fc5-879b-ebee0bcaec48 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.278613 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33782597-d79a-4fc5-879b-ebee0bcaec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.278746 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5ce58-2733-41a7-98dc-7b80c79aede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.278894 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33782597-d79a-4fc5-879b-ebee0bcaec48 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.279353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5ce58-2733-41a7-98dc-7b80c79aede0 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.279608 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33782597-d79a-4fc5-879b-ebee0bcaec48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:14.279705 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5ce58-2733-41a7-98dc-7b80c79aede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.279936 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5ce58-2733-41a7-98dc-7b80c79aede0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.283540 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5ce58-2733-41a7-98dc-7b80c79aede0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:14.283646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33782597-d79a-4fc5-879b-ebee0bcaec48 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:14.283719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5ce58-2733-41a7-98dc-7b80c79aede0 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:14.292893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1378/2764] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:14 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:14.296991 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5ce58-2733-41a7-98dc-7b80c79aede0 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:14.307356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5ce58-2733-41a7-98dc-7b80c79aede0 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.312677 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61621db4-e961-4e68-8b0c-ebbc9ac73e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.313421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61621db4-e961-4e68-8b0c-ebbc9ac73e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.313710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61621db4-e961-4e68-8b0c-ebbc9ac73e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.313996 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61621db4-e961-4e68-8b0c-ebbc9ac73e96 admin admin] PATH_INFO: `/v3/projects/033575ce14db453dbce3078e9ce6e17a/users/f5548bbc932e4734a5c0dd34bb34ef27/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.316039 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61621db4-e961-4e68-8b0c-ebbc9ac73e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033575ce14db453dbce3078e9ce6e17a, user_id=f5548bbc932e4734a5c0dd34bb34ef27, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:14.318767 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61621db4-e961-4e68-8b0c-ebbc9ac73e96 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:14.330014 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1379/2765] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:24:14 2021] PUT /identity/v3/projects/033575ce14db453dbce3078e9ce6e17a/users/f5548bbc932e4734a5c0dd34bb34ef27/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:24:14.393073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1387/2766] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 05:24:14 2021] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:24:14.394296 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61621db4-e961-4e68-8b0c-ebbc9ac73e96 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:14.463725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61621db4-e961-4e68-8b0c-ebbc9ac73e96 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.469672 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bce9a5-0cca-466e-a1d2-a69acfb58c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.470798 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bce9a5-0cca-466e-a1d2-a69acfb58c88 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.471104 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bce9a5-0cca-466e-a1d2-a69acfb58c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.471352 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bce9a5-0cca-466e-a1d2-a69acfb58c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.472080 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bce9a5-0cca-466e-a1d2-a69acfb58c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:14.473734 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bce9a5-0cca-466e-a1d2-a69acfb58c88 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:14.487823 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1380/2767] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:14 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:14.488783 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33782597-d79a-4fc5-879b-ebee0bcaec48 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:14.499489 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33782597-d79a-4fc5-879b-ebee0bcaec48 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.504787 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeae40-0d4a-4f8e-ad67-5e13d12225b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.505676 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeae40-0d4a-4f8e-ad67-5e13d12225b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.505955 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeae40-0d4a-4f8e-ad67-5e13d12225b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.506230 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeae40-0d4a-4f8e-ad67-5e13d12225b3 admin admin] PATH_INFO: `/v3/projects/bfa3340b90bb47c9bc57228f6d07e415/users/06feea4e842d49098da7635f5f950b63/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.522957 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaeae40-0d4a-4f8e-ad67-5e13d12225b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa3340b90bb47c9bc57228f6d07e415, user_id=06feea4e842d49098da7635f5f950b63, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:14.525935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaeae40-0d4a-4f8e-ad67-5e13d12225b3 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:14.612922 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1388/2768] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:24:14 2021] PUT /identity/v3/projects/bfa3340b90bb47c9bc57228f6d07e415/users/06feea4e842d49098da7635f5f950b63/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:24:14.617481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bce9a5-0cca-466e-a1d2-a69acfb58c88 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:14.629423 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bce9a5-0cca-466e-a1d2-a69acfb58c88 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.700636 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d67d05-4c5f-4502-9215-8dadbaf6e7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.701435 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d67d05-4c5f-4502-9215-8dadbaf6e7ae admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.701825 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d67d05-4c5f-4502-9215-8dadbaf6e7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.702176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d67d05-4c5f-4502-9215-8dadbaf6e7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.703005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d67d05-4c5f-4502-9215-8dadbaf6e7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:14.704759 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d67d05-4c5f-4502-9215-8dadbaf6e7ae admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:14.716218 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1381/2769] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:14 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:14.719969 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeae40-0d4a-4f8e-ad67-5e13d12225b3 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:14.731679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeae40-0d4a-4f8e-ad67-5e13d12225b3 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.736302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9cba0-d535-4d9d-a580-ed0c0f0d74f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.737208 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9cba0-d535-4d9d-a580-ed0c0f0d74f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.737494 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9cba0-d535-4d9d-a580-ed0c0f0d74f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.738551 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9cba0-d535-4d9d-a580-ed0c0f0d74f8 admin admin] PATH_INFO: `/v3/projects/bfa3340b90bb47c9bc57228f6d07e415/users/06feea4e842d49098da7635f5f950b63/roles/7f4a5a2bd63941a9bab25565091ffe74` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.739964 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9cba0-d535-4d9d-a580-ed0c0f0d74f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa3340b90bb47c9bc57228f6d07e415, user_id=06feea4e842d49098da7635f5f950b63, role_id=7f4a5a2bd63941a9bab25565091ffe74)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:14.743333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9cba0-d535-4d9d-a580-ed0c0f0d74f8 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:14.754075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1389/2770] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:24:14 2021] PUT /identity/v3/projects/bfa3340b90bb47c9bc57228f6d07e415/users/06feea4e842d49098da7635f5f950b63/roles/7f4a5a2bd63941a9bab25565091ffe74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:24:14.765430 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cf431-cd9a-48da-a0e6-169a62211815 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.765813 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cf431-cd9a-48da-a0e6-169a62211815 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.766099 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cf431-cd9a-48da-a0e6-169a62211815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:14.796788 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-660cf431-cd9a-48da-a0e6-169a62211815 None None] MFA Rules not processed for user `06feea4e842d49098da7635f5f950b63`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:14.798028 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-660cf431-cd9a-48da-a0e6-169a62211815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:14.871265 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1382/2771] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:14 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:14.882054 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9cba0-d535-4d9d-a580-ed0c0f0d74f8 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:14.883769 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-58f9cba0-d535-4d9d-a580-ed0c0f0d74f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:14.948170 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9cba0-d535-4d9d-a580-ed0c0f0d74f8 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:14.951897 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471080d-626a-4927-9409-f9202032ee8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:14.952569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471080d-626a-4927-9409-f9202032ee8d service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:14.953812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471080d-626a-4927-9409-f9202032ee8d service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:14.953812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471080d-626a-4927-9409-f9202032ee8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:15.007766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471080d-626a-4927-9409-f9202032ee8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:15.009263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471080d-626a-4927-9409-f9202032ee8d service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:15.018698 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1390/2772] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:14 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:19.574945 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e517d-b6ee-455d-87b2-041ca41a4cd7 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:19.575407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e517d-b6ee-455d-87b2-041ca41a4cd7 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:19.575667 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e517d-b6ee-455d-87b2-041ca41a4cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:19.608587 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-f18e517d-b6ee-455d-87b2-041ca41a4cd7 None None] MFA Rules not processed for user `f5548bbc932e4734a5c0dd34bb34ef27`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:19.609938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f18e517d-b6ee-455d-87b2-041ca41a4cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:19.677617 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1383/2773] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:19 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:19.689047 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471080d-626a-4927-9409-f9202032ee8d service cinder] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:19.690573 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c471080d-626a-4927-9409-f9202032ee8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:19.783099 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471080d-626a-4927-9409-f9202032ee8d service cinder] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:19.794191 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a89936-3c11-4bd5-b0be-0244e571d555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:19.794982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a89936-3c11-4bd5-b0be-0244e571d555 service nova] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:19.795260 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a89936-3c11-4bd5-b0be-0244e571d555 service nova] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:19.795539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a89936-3c11-4bd5-b0be-0244e571d555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:19.854027 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a89936-3c11-4bd5-b0be-0244e571d555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:19.855867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a89936-3c11-4bd5-b0be-0244e571d555 service nova] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:19.865875 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1391/2774] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:19 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:21.555559 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e517d-b6ee-455d-87b2-041ca41a4cd7 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:21.557074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-f18e517d-b6ee-455d-87b2-041ca41a4cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:21.569439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e517d-b6ee-455d-87b2-041ca41a4cd7 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:21.573356 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171a1dd-6328-489e-9815-0d5a28d70f84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:21.573987 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a1dd-6328-489e-9815-0d5a28d70f84 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:21.574271 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a1dd-6328-489e-9815-0d5a28d70f84 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:21.574547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a1dd-6328-489e-9815-0d5a28d70f84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:21.583313 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171a1dd-6328-489e-9815-0d5a28d70f84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:21.585350 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171a1dd-6328-489e-9815-0d5a28d70f84 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:21.594618 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1384/2775] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:21 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:22.489321 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682690b-a81f-42ad-8664-5e45c25107c5 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:22.489781 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682690b-a81f-42ad-8664-5e45c25107c5 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:22.489864 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682690b-a81f-42ad-8664-5e45c25107c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:22.507129 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-c682690b-a81f-42ad-8664-5e45c25107c5 None None] MFA Rules not processed for user `daa43240be34453a8090767848538c99`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:22.508464 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c682690b-a81f-42ad-8664-5e45c25107c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:22.515193 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1392/2776] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:22 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:45.729988 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171a1dd-6328-489e-9815-0d5a28d70f84 service cinder] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:45.731475 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-4171a1dd-6328-489e-9815-0d5a28d70f84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:45.784842 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171a1dd-6328-489e-9815-0d5a28d70f84 service cinder] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:45.789112 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1afb4-fee2-4e18-a9bc-d6591e1a0406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:45.789749 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1afb4-fee2-4e18-a9bc-d6591e1a0406 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:45.790032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1afb4-fee2-4e18-a9bc-d6591e1a0406 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:45.790306 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1afb4-fee2-4e18-a9bc-d6591e1a0406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:45.792049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-5fc1afb4-fee2-4e18-a9bc-d6591e1a0406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:45.801240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1afb4-fee2-4e18-a9bc-d6591e1a0406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:45.802646 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1afb4-fee2-4e18-a9bc-d6591e1a0406 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:45.810388 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1385/2777] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:45 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:46.771392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682690b-a81f-42ad-8664-5e45c25107c5 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:46.772994 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-c682690b-a81f-42ad-8664-5e45c25107c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:46.839853 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682690b-a81f-42ad-8664-5e45c25107c5 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:46.844856 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb990601-61d6-4d36-839e-9933f971928c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:46.845500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb990601-61d6-4d36-839e-9933f971928c service placement] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:46.845788 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb990601-61d6-4d36-839e-9933f971928c service placement] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:46.846066 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb990601-61d6-4d36-839e-9933f971928c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:46.847859 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-bb990601-61d6-4d36-839e-9933f971928c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:46.858799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb990601-61d6-4d36-839e-9933f971928c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:46.860394 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb990601-61d6-4d36-839e-9933f971928c service placement] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:46.870434 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1393/2778] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:46 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:50.412930 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1afb4-fee2-4e18-a9bc-d6591e1a0406 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:50.480199 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1afb4-fee2-4e18-a9bc-d6591e1a0406 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:50.486197 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:50.487427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:50.487912 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:50.488459 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] PATH_INFO: `/v3/users/eee4709cf8c1417cb9f5aca0165561f9` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:50.489821 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee4709cf8c1417cb9f5aca0165561f9)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:50.492110 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:50.755320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee4709cf8c1417cb9f5aca0165561f9'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:50.772091 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee4709cf8c1417cb9f5aca0165561f9'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:50.773731 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee4709cf8c1417cb9f5aca0165561f9'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:50.784032 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee4709cf8c1417cb9f5aca0165561f9'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:50.879750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee4709cf8c1417cb9f5aca0165561f9'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:50.888343 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1386/2779] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:24:50 2021] DELETE /identity/v3/users/eee4709cf8c1417cb9f5aca0165561f9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:50.893023 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be7a5-9169-44a0-8ca4-6e0a99867395 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:50.893846 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be7a5-9169-44a0-8ca4-6e0a99867395 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:50.894124 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be7a5-9169-44a0-8ca4-6e0a99867395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:50.912385 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3e7be7a5-9169-44a0-8ca4-6e0a99867395 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:50.914184 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3e7be7a5-9169-44a0-8ca4-6e0a99867395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:50.971654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1394/2780] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:50.981957 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:50.983358 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:51.039455 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0968c-b7c5-4845-bf81-fe86a59dd7bb admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:51.043408 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58277b-08d5-4980-9881-b821623d4390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:51.044062 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58277b-08d5-4980-9881-b821623d4390 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:51.044367 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58277b-08d5-4980-9881-b821623d4390 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:51.044648 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58277b-08d5-4980-9881-b821623d4390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:51.054045 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58277b-08d5-4980-9881-b821623d4390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:51.055582 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58277b-08d5-4980-9881-b821623d4390 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:51.065174 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1387/2781] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:51.623633 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7be7a5-9169-44a0-8ca4-6e0a99867395 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:51.625057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3e7be7a5-9169-44a0-8ca4-6e0a99867395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:51.641347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7be7a5-9169-44a0-8ca4-6e0a99867395 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:51.646795 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:51.647696 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:51.648568 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:51.649103 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] PATH_INFO: `/v3/projects/e3f321798ab447eca9f938207d81539b` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:51.650204 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f321798ab447eca9f938207d81539b)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:51.652142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:51.759766 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f321798ab447eca9f938207d81539b', 'request_id': 'req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:51.816396 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f321798ab447eca9f938207d81539b', 'request_id': 'req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:51.822544 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f321798ab447eca9f938207d81539b', 'request_id': 'req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:51.833052 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] The token cache is being invalidate because project e3f321798ab447eca9f938207d81539b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:24:51.833333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:51.833950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:51.835453 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1395/2782] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:24:51 2021] DELETE /identity/v3/projects/e3f321798ab447eca9f938207d81539b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:51.839508 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58277b-08d5-4980-9881-b821623d4390 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:51.848949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58277b-08d5-4980-9881-b821623d4390 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:51.902316 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:51.903186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:51.903473 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:51.903752 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] PATH_INFO: `/v3/users/06feea4e842d49098da7635f5f950b63` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:51.904968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06feea4e842d49098da7635f5f950b63)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:51.906885 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:52.092506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06feea4e842d49098da7635f5f950b63'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:52.104177 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06feea4e842d49098da7635f5f950b63'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:52.104963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06feea4e842d49098da7635f5f950b63'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:52.111427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06feea4e842d49098da7635f5f950b63'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:52.193431 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-445dc78d-2a93-4dea-9f69-ae835ba0eb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06feea4e842d49098da7635f5f950b63'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:52.199704 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1388/2783] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:24:51 2021] DELETE /identity/v3/users/06feea4e842d49098da7635f5f950b63 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:52.681440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:52.683025 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:52.700852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe0ca7-c5f5-4868-9f37-38ec3159d87b admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:52.754778 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:52.755623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:52.755900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:52.756168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] PATH_INFO: `/v3/projects/bfa3340b90bb47c9bc57228f6d07e415` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:52.757348 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa3340b90bb47c9bc57228f6d07e415)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:52.759242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:52.864236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa3340b90bb47c9bc57228f6d07e415', 'request_id': 'req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:52.939485 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa3340b90bb47c9bc57228f6d07e415', 'request_id': 'req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:52.945595 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa3340b90bb47c9bc57228f6d07e415', 'request_id': 'req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:52.956110 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] The token cache is being invalidate because project bfa3340b90bb47c9bc57228f6d07e415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:24:52.956537 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:52.957035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-a824eb7b-8f5d-4035-9994-8e2fdb5f5f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:52.958541 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1396/2784] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:24:52 2021] DELETE /identity/v3/projects/bfa3340b90bb47c9bc57228f6d07e415 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:52.964893 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a40f-4777-4a78-883b-186d58c72ca2 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:52.965371 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a40f-4777-4a78-883b-186d58c72ca2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:52.965484 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a40f-4777-4a78-883b-186d58c72ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:52.985046 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-c120a40f-4777-4a78-883b-186d58c72ca2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:52.986249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-c120a40f-4777-4a78-883b-186d58c72ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:53.041491 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1389/2785] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:53.049420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565eb5-8498-4b47-bd9b-16ea9010bb12 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:53.049705 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565eb5-8498-4b47-bd9b-16ea9010bb12 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:53.049982 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565eb5-8498-4b47-bd9b-16ea9010bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:53.067572 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-11565eb5-8498-4b47-bd9b-16ea9010bb12 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:53.068791 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-11565eb5-8498-4b47-bd9b-16ea9010bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:53.077331 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1397/2786] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:53.081474 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120a40f-4777-4a78-883b-186d58c72ca2 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:53.092533 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120a40f-4777-4a78-883b-186d58c72ca2 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:53.097164 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86094ef-716e-41e2-a42d-130694a2a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:53.097804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86094ef-716e-41e2-a42d-130694a2a121 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:53.098087 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86094ef-716e-41e2-a42d-130694a2a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:53.098364 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86094ef-716e-41e2-a42d-130694a2a121 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:53.099074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86094ef-716e-41e2-a42d-130694a2a121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:24:53.099377 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86094ef-716e-41e2-a42d-130694a2a121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:53.101118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86094ef-716e-41e2-a42d-130694a2a121 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:53.112208 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1390/2787] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 05:24:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:24:53.116429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565eb5-8498-4b47-bd9b-16ea9010bb12 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:53.125592 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565eb5-8498-4b47-bd9b-16ea9010bb12 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:53.130430 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f572ff-6374-4468-b1a2-44b3b4043ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:53.131072 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f572ff-6374-4468-b1a2-44b3b4043ffb admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:53.131390 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f572ff-6374-4468-b1a2-44b3b4043ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:53.131663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f572ff-6374-4468-b1a2-44b3b4043ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:53.132899 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f572ff-6374-4468-b1a2-44b3b4043ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:53.134902 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f572ff-6374-4468-b1a2-44b3b4043ffb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:53.235297 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1398/2788] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 05:24:53 2021] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:24:53.239379 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86094ef-716e-41e2-a42d-130694a2a121 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:53.249857 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86094ef-716e-41e2-a42d-130694a2a121 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:53.302853 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e748b-e2f6-41b8-bf7e-7a087ebed399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:53.303519 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e748b-e2f6-41b8-bf7e-7a087ebed399 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:53.303804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e748b-e2f6-41b8-bf7e-7a087ebed399 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:53.304628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e748b-e2f6-41b8-bf7e-7a087ebed399 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:53.305303 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e748b-e2f6-41b8-bf7e-7a087ebed399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:53.307212 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e748b-e2f6-41b8-bf7e-7a087ebed399 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:53.394118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1391/2789] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 05:24:53 2021] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:24:53.397971 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f572ff-6374-4468-b1a2-44b3b4043ffb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:53.408178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f572ff-6374-4468-b1a2-44b3b4043ffb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:53.412867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b6116-7418-4221-83b4-39dbfe248afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:53.413517 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b6116-7418-4221-83b4-39dbfe248afd admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:53.413803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b6116-7418-4221-83b4-39dbfe248afd admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:53.414083 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b6116-7418-4221-83b4-39dbfe248afd admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:53.414807 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b6116-7418-4221-83b4-39dbfe248afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:53.416428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b6116-7418-4221-83b4-39dbfe248afd admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:53.426500 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1399/2790] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:53.430743 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e748b-e2f6-41b8-bf7e-7a087ebed399 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:53.440692 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e748b-e2f6-41b8-bf7e-7a087ebed399 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:53.446429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eaedc-c380-4b23-8b0b-cabefa922990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:53.447076 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eaedc-c380-4b23-8b0b-cabefa922990 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:53.447362 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eaedc-c380-4b23-8b0b-cabefa922990 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:53.447640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eaedc-c380-4b23-8b0b-cabefa922990 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:53.448374 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eaedc-c380-4b23-8b0b-cabefa922990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:53.449968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eaedc-c380-4b23-8b0b-cabefa922990 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:53.459725 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1392/2791] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:53.463852 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b6116-7418-4221-83b4-39dbfe248afd admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:53.473764 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b6116-7418-4221-83b4-39dbfe248afd admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:53.478362 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4708f8-3f2d-4291-bc07-25af3214f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:53.479223 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4708f8-3f2d-4291-bc07-25af3214f9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:53.479508 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4708f8-3f2d-4291-bc07-25af3214f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:53.479787 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4708f8-3f2d-4291-bc07-25af3214f9f6 admin admin] PATH_INFO: `/v3/projects/05bdf5059ef7452ea98e2a574d77d01e/users/953b2265acdc445c9c55f884d67c2c5a/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:53.497406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4708f8-3f2d-4291-bc07-25af3214f9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bdf5059ef7452ea98e2a574d77d01e, user_id=953b2265acdc445c9c55f884d67c2c5a, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:53.497406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4708f8-3f2d-4291-bc07-25af3214f9f6 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:53.576160 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1400/2792] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:24:53 2021] PUT /identity/v3/projects/05bdf5059ef7452ea98e2a574d77d01e/users/953b2265acdc445c9c55f884d67c2c5a/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:53.587366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3628d4-563a-41f8-9875-6c761a5780d5 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:53.587655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3628d4-563a-41f8-9875-6c761a5780d5 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:53.587934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3628d4-563a-41f8-9875-6c761a5780d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:53.615049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-bc3628d4-563a-41f8-9875-6c761a5780d5 None None] MFA Rules not processed for user `953b2265acdc445c9c55f884d67c2c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:53.617391 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-bc3628d4-563a-41f8-9875-6c761a5780d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:53.681722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1393/2793] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:53 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:53.692543 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4708f8-3f2d-4291-bc07-25af3214f9f6 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:53.693995 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-ee4708f8-3f2d-4291-bc07-25af3214f9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:53.751701 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4708f8-3f2d-4291-bc07-25af3214f9f6 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:53.755549 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4df4d-5f55-4fce-9311-2ad7a18055ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:53.756192 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4df4d-5f55-4fce-9311-2ad7a18055ab service cinder] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:53.756521 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4df4d-5f55-4fce-9311-2ad7a18055ab service cinder] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:53.756803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4df4d-5f55-4fce-9311-2ad7a18055ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:53.765323 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4df4d-5f55-4fce-9311-2ad7a18055ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:53.766808 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4df4d-5f55-4fce-9311-2ad7a18055ab service cinder] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:53.775488 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1401/2794] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:53 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:53.794862 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3628d4-563a-41f8-9875-6c761a5780d5 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:53.853481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3628d4-563a-41f8-9875-6c761a5780d5 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:53.858040 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:53.858887 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:53.859166 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:53.859437 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] PATH_INFO: `/v3/users/953b2265acdc445c9c55f884d67c2c5a` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:53.860638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] RBAC: Authorizing `identity:delete_user(user_id=953b2265acdc445c9c55f884d67c2c5a)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:53.862523 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:54.016298 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953b2265acdc445c9c55f884d67c2c5a'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:54.028075 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953b2265acdc445c9c55f884d67c2c5a'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:54.028784 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953b2265acdc445c9c55f884d67c2c5a'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:54.035457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953b2265acdc445c9c55f884d67c2c5a'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:54.117170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953b2265acdc445c9c55f884d67c2c5a'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:54.123485 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1394/2795] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:24:53 2021] DELETE /identity/v3/users/953b2265acdc445c9c55f884d67c2c5a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:54.128310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519dce-a7fa-4462-82df-764cf447b361 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:54.128664 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519dce-a7fa-4462-82df-764cf447b361 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:54.128951 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519dce-a7fa-4462-82df-764cf447b361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:54.145792 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-14519dce-a7fa-4462-82df-764cf447b361 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:54.147000 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-14519dce-a7fa-4462-82df-764cf447b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:54.202318 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1402/2796] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:24:54.212807 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:54.214220 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:54.269566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c309f-b5a9-49bb-a97f-44a518df650c admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:54.273800 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4cd0d-22f3-4b93-8550-20957fd92303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:54.274439 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4cd0d-22f3-4b93-8550-20957fd92303 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:54.274726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4cd0d-22f3-4b93-8550-20957fd92303 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:54.275011 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4cd0d-22f3-4b93-8550-20957fd92303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:54.283835 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4cd0d-22f3-4b93-8550-20957fd92303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:54.285285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4cd0d-22f3-4b93-8550-20957fd92303 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:54.295077 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1395/2797] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:24:54.714970 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14519dce-a7fa-4462-82df-764cf447b361 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:54.716403 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-14519dce-a7fa-4462-82df-764cf447b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:54.729529 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14519dce-a7fa-4462-82df-764cf447b361 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:54.733236 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:54.734081 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:54.734354 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:54.734623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] PATH_INFO: `/v3/projects/05bdf5059ef7452ea98e2a574d77d01e` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:54.735806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bdf5059ef7452ea98e2a574d77d01e)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:54.737754 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:54.840569 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bdf5059ef7452ea98e2a574d77d01e', 'request_id': 'req-50b2cfac-c945-436a-bec1-3921c6e68895'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:54.919566 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bdf5059ef7452ea98e2a574d77d01e', 'request_id': 'req-50b2cfac-c945-436a-bec1-3921c6e68895'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:54.925625 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bdf5059ef7452ea98e2a574d77d01e', 'request_id': 'req-50b2cfac-c945-436a-bec1-3921c6e68895'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:54.936870 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] The token cache is being invalidate because project 05bdf5059ef7452ea98e2a574d77d01e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:24:54.937164 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:54.937794 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-50b2cfac-c945-436a-bec1-3921c6e68895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:24:54.939412 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1403/2798] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:24:54 2021] DELETE /identity/v3/projects/05bdf5059ef7452ea98e2a574d77d01e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:24:54.945382 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97f892-fe64-4c88-9f9f-9a5a6f40a847 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:54.945681 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97f892-fe64-4c88-9f9f-9a5a6f40a847 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:54.945964 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97f892-fe64-4c88-9f9f-9a5a6f40a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:54.964002 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-8a97f892-fe64-4c88-9f9f-9a5a6f40a847 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:54.965254 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8a97f892-fe64-4c88-9f9f-9a5a6f40a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:55.021229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1396/2799] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:55.029563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c143f-27f5-416c-877e-10f48607ac44 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:55.029858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c143f-27f5-416c-877e-10f48607ac44 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:55.030140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c143f-27f5-416c-877e-10f48607ac44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:55.048580 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-3c4c143f-27f5-416c-877e-10f48607ac44 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:55.049761 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-3c4c143f-27f5-416c-877e-10f48607ac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:55.057473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1404/2800] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:24:55.063369 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97f892-fe64-4c88-9f9f-9a5a6f40a847 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:55.073576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97f892-fe64-4c88-9f9f-9a5a6f40a847 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:55.078291 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f166c-1027-4832-be06-ece5146724f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:55.078908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f166c-1027-4832-be06-ece5146724f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:55.079192 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f166c-1027-4832-be06-ece5146724f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:55.079469 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f166c-1027-4832-be06-ece5146724f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:55.080193 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f166c-1027-4832-be06-ece5146724f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73667) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:24:55.080556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f166c-1027-4832-be06-ece5146724f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:55.082136 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f166c-1027-4832-be06-ece5146724f2 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:55.093969 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1397/2801] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 05:24:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:24:55.097967 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c143f-27f5-416c-877e-10f48607ac44 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:55.107682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c143f-27f5-416c-877e-10f48607ac44 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:55.113433 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6701-8ae1-4751-94ce-3bb05cdc7a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:55.114076 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6701-8ae1-4751-94ce-3bb05cdc7a27 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:55.114362 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6701-8ae1-4751-94ce-3bb05cdc7a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:55.114636 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6701-8ae1-4751-94ce-3bb05cdc7a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:55.115333 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f6701-8ae1-4751-94ce-3bb05cdc7a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:55.117279 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f6701-8ae1-4751-94ce-3bb05cdc7a27 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:55.228752 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1405/2802] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 05:24:55 2021] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:24:55.232880 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f166c-1027-4832-be06-ece5146724f2 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:55.242768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f166c-1027-4832-be06-ece5146724f2 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:55.297214 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae76aa9-5ee8-4034-9596-cbeca6fa5560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:55.297878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76aa9-5ee8-4034-9596-cbeca6fa5560 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:55.298160 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76aa9-5ee8-4034-9596-cbeca6fa5560 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:55.298438 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76aa9-5ee8-4034-9596-cbeca6fa5560 admin admin] PATH_INFO: `/v3/users` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:55.299108 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae76aa9-5ee8-4034-9596-cbeca6fa5560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:55.301053 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae76aa9-5ee8-4034-9596-cbeca6fa5560 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:55.371710 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1398/2803] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 05:24:55 2021] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:24:55.379282 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6701-8ae1-4751-94ce-3bb05cdc7a27 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:55.389867 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6701-8ae1-4751-94ce-3bb05cdc7a27 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:55.394456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7326d-f540-4186-83ba-54527bc3b91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:55.395101 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7326d-f540-4186-83ba-54527bc3b91e admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:55.395380 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7326d-f540-4186-83ba-54527bc3b91e admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:55.395653 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7326d-f540-4186-83ba-54527bc3b91e admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:55.396396 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7326d-f540-4186-83ba-54527bc3b91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:55.398542 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7326d-f540-4186-83ba-54527bc3b91e admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:55.408560 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1406/2804] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:55.412321 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae76aa9-5ee8-4034-9596-cbeca6fa5560 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:55.422126 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae76aa9-5ee8-4034-9596-cbeca6fa5560 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:55.426730 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2054d0-722c-4d01-bce3-dabaa4a06438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:55.427375 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2054d0-722c-4d01-bce3-dabaa4a06438 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:55.427655 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2054d0-722c-4d01-bce3-dabaa4a06438 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:55.427927 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2054d0-722c-4d01-bce3-dabaa4a06438 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:55.428699 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2054d0-722c-4d01-bce3-dabaa4a06438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:55.430281 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2054d0-722c-4d01-bce3-dabaa4a06438 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:55.439718 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1399/2805] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:24:55 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:24:55.443346 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7326d-f540-4186-83ba-54527bc3b91e admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:55.453355 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7326d-f540-4186-83ba-54527bc3b91e admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:55.457841 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c36b67-9ab5-449d-8261-24e1d3a69813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:55.458675 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c36b67-9ab5-449d-8261-24e1d3a69813 admin admin] REQUEST_METHOD: `PUT` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:55.458952 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c36b67-9ab5-449d-8261-24e1d3a69813 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:55.459220 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c36b67-9ab5-449d-8261-24e1d3a69813 admin admin] PATH_INFO: `/v3/projects/7d8eabf170bf42b78c16c32bdb1fe73d/users/a1a884bcaf1a4c958f92f5a8fcb76075/roles/70600290909e4c808126b1efb2142b05` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:55.475068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c36b67-9ab5-449d-8261-24e1d3a69813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8eabf170bf42b78c16c32bdb1fe73d, user_id=a1a884bcaf1a4c958f92f5a8fcb76075, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:55.477802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c36b67-9ab5-449d-8261-24e1d3a69813 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:55.559423 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1407/2806] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:24:55 2021] PUT /identity/v3/projects/7d8eabf170bf42b78c16c32bdb1fe73d/users/a1a884bcaf1a4c958f92f5a8fcb76075/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:24:55.574223 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2940-40c3-40f9-94b0-fa9921557129 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:55.574546 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2940-40c3-40f9-94b0-fa9921557129 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:55.574821 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2940-40c3-40f9-94b0-fa9921557129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:55.599804 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-208f2940-40c3-40f9-94b0-fa9921557129 None None] MFA Rules not processed for user `a1a884bcaf1a4c958f92f5a8fcb76075`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:24:55.601018 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-208f2940-40c3-40f9-94b0-fa9921557129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:55.661527 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1400/2807] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:24:55 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:24:55.672635 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c36b67-9ab5-449d-8261-24e1d3a69813 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:24:55.674286 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-97c36b67-9ab5-449d-8261-24e1d3a69813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:24:55.749245 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c36b67-9ab5-449d-8261-24e1d3a69813 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:24:55.752896 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39737e-f5ee-4a03-8525-2c390e1b8407 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f041d8d6b5949c48920b729511f3783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:24:55.753527 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39737e-f5ee-4a03-8525-2c390e1b8407 service glance] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:24:55.753803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39737e-f5ee-4a03-8525-2c390e1b8407 service glance] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:24:55.754088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39737e-f5ee-4a03-8525-2c390e1b8407 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:24:55.762646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39737e-f5ee-4a03-8525-2c390e1b8407 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:24:55.764068 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39737e-f5ee-4a03-8525-2c390e1b8407 service glance] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:24:55.772807 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1408/2808] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:24:55 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:25:01.737997 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f2940-40c3-40f9-94b0-fa9921557129 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:01.740768 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-208f2940-40c3-40f9-94b0-fa9921557129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:01.941556 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f2940-40c3-40f9-94b0-fa9921557129 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:01.952684 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47aa4-78c2-4e94-87db-ebb9c0413979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:01.953697 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47aa4-78c2-4e94-87db-ebb9c0413979 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:01.954205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47aa4-78c2-4e94-87db-ebb9c0413979 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:01.954597 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47aa4-78c2-4e94-87db-ebb9c0413979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:01.957049 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-34b47aa4-78c2-4e94-87db-ebb9c0413979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:01.972669 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b47aa4-78c2-4e94-87db-ebb9c0413979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:01.975365 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b47aa4-78c2-4e94-87db-ebb9c0413979 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:01.987131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1401/2809] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:25:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:25:04.449750 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39737e-f5ee-4a03-8525-2c390e1b8407 service glance] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:04.451222 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4d39737e-f5ee-4a03-8525-2c390e1b8407 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:04.507255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39737e-f5ee-4a03-8525-2c390e1b8407 service glance] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:04.510838 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bb865-1f05-4f40-a6d2-2a548a028627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:04.511480 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bb865-1f05-4f40-a6d2-2a548a028627 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:04.511763 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bb865-1f05-4f40-a6d2-2a548a028627 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:04.512035 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bb865-1f05-4f40-a6d2-2a548a028627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:04.513802 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f73bb865-1f05-4f40-a6d2-2a548a028627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:04.575775 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bb865-1f05-4f40-a6d2-2a548a028627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:04.577183 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bb865-1f05-4f40-a6d2-2a548a028627 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:04.586950 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1409/2810] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:25:04 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:25:06.571551 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47aa4-78c2-4e94-87db-ebb9c0413979 service nova] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:06.584486 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47aa4-78c2-4e94-87db-ebb9c0413979 service nova] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:06.590852 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1cbd0-aa02-4483-8922-f85de7083507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:06.591506 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1cbd0-aa02-4483-8922-f85de7083507 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:06.591810 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1cbd0-aa02-4483-8922-f85de7083507 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:06.592135 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1cbd0-aa02-4483-8922-f85de7083507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:06.593934 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-68e1cbd0-aa02-4483-8922-f85de7083507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:06.606217 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1cbd0-aa02-4483-8922-f85de7083507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:06.607794 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1cbd0-aa02-4483-8922-f85de7083507 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:06.618204 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1402/2811] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:25:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:25:14.034472 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bb865-1f05-4f40-a6d2-2a548a028627 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:14.094024 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bb865-1f05-4f40-a6d2-2a548a028627 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:14.098563 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:14.099413 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:14.099799 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:14.100091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] PATH_INFO: `/v3/users/a1a884bcaf1a4c958f92f5a8fcb76075` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:14.101299 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a884bcaf1a4c958f92f5a8fcb76075)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:14.103287 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:14.291850 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a884bcaf1a4c958f92f5a8fcb76075'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:14.292534 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a884bcaf1a4c958f92f5a8fcb76075'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:14.293147 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a884bcaf1a4c958f92f5a8fcb76075'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:14.304313 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a884bcaf1a4c958f92f5a8fcb76075'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:14.381016 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a884bcaf1a4c958f92f5a8fcb76075'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:14.393538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1410/2812] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:25:14 2021] DELETE /identity/v3/users/a1a884bcaf1a4c958f92f5a8fcb76075 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:25:14.398031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cd9da-05c7-4ad5-84aa-74885afebb2d None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:14.398474 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cd9da-05c7-4ad5-84aa-74885afebb2d None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:14.398608 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cd9da-05c7-4ad5-84aa-74885afebb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:14.416176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-8c6cd9da-05c7-4ad5-84aa-74885afebb2d None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:25:14.417404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8c6cd9da-05c7-4ad5-84aa-74885afebb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:14.472861 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1403/2813] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:25:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:25:14.482637 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:14.484044 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:14.542028 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954f1f9-8c7e-4cd4-9c90-c91f77c436dd admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:14.545593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ddbd1-c45e-4a46-96f9-624aabdeb001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:14.546217 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ddbd1-c45e-4a46-96f9-624aabdeb001 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:14.546496 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ddbd1-c45e-4a46-96f9-624aabdeb001 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:14.546773 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ddbd1-c45e-4a46-96f9-624aabdeb001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:14.555612 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ddbd1-c45e-4a46-96f9-624aabdeb001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:14.557623 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ddbd1-c45e-4a46-96f9-624aabdeb001 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:14.566708 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1411/2814] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:25:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:25:14.962706 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cd9da-05c7-4ad5-84aa-74885afebb2d None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:14.964131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8c6cd9da-05c7-4ad5-84aa-74885afebb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:14.976026 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cd9da-05c7-4ad5-84aa-74885afebb2d None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:14.981487 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:14.982360 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:14.982650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:14.982925 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] PATH_INFO: `/v3/projects/7d8eabf170bf42b78c16c32bdb1fe73d` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:14.984142 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8eabf170bf42b78c16c32bdb1fe73d)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:14.986085 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:15.096959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8eabf170bf42b78c16c32bdb1fe73d', 'request_id': 'req-db156a29-5b58-4c9a-8051-c0030b34f6d7'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:15.103052 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8eabf170bf42b78c16c32bdb1fe73d', 'request_id': 'req-db156a29-5b58-4c9a-8051-c0030b34f6d7'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:15.108976 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8eabf170bf42b78c16c32bdb1fe73d', 'request_id': 'req-db156a29-5b58-4c9a-8051-c0030b34f6d7'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:15.187158 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] The token cache is being invalidate because project 7d8eabf170bf42b78c16c32bdb1fe73d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:25:15.187458 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:15.188100 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-db156a29-5b58-4c9a-8051-c0030b34f6d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:15.189726 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1404/2815] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:25:14 2021] DELETE /identity/v3/projects/7d8eabf170bf42b78c16c32bdb1fe73d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:25:15.196094 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e4f8d-ca60-4180-a604-1959ec0acfb6 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:15.196557 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e4f8d-ca60-4180-a604-1959ec0acfb6 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:15.196654 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e4f8d-ca60-4180-a604-1959ec0acfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:15.214140 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-642e4f8d-ca60-4180-a604-1959ec0acfb6 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:25:15.215363 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-642e4f8d-ca60-4180-a604-1959ec0acfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:15.272199 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1412/2816] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:25:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:25:15.321576 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800262-dcc5-41e5-b5d4-a7269a0dc8b9 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:15.321866 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800262-dcc5-41e5-b5d4-a7269a0dc8b9 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:15.322148 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800262-dcc5-41e5-b5d4-a7269a0dc8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:15.340481 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-ed800262-dcc5-41e5-b5d4-a7269a0dc8b9 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:25:15.341675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ed800262-dcc5-41e5-b5d4-a7269a0dc8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:15.349515 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1405/2817] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:25:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:25:15.353479 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e4f8d-ca60-4180-a604-1959ec0acfb6 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:15.363539 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e4f8d-ca60-4180-a604-1959ec0acfb6 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:15.368126 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409081b-1d53-4aaa-b443-d97e8c15e7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:15.368806 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409081b-1d53-4aaa-b443-d97e8c15e7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:15.369096 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409081b-1d53-4aaa-b443-d97e8c15e7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:15.369419 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409081b-1d53-4aaa-b443-d97e8c15e7d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:15.370142 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409081b-1d53-4aaa-b443-d97e8c15e7d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:25:15.370451 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409081b-1d53-4aaa-b443-d97e8c15e7d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:15.372060 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409081b-1d53-4aaa-b443-d97e8c15e7d7 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:15.383087 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1413/2818] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 05:25:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:25:15.387019 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed800262-dcc5-41e5-b5d4-a7269a0dc8b9 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:15.396008 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed800262-dcc5-41e5-b5d4-a7269a0dc8b9 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:15.401149 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f0c47-38be-4e93-9d7d-d1bc18898bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:15.401781 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f0c47-38be-4e93-9d7d-d1bc18898bcf admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:15.402061 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f0c47-38be-4e93-9d7d-d1bc18898bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:15.402332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f0c47-38be-4e93-9d7d-d1bc18898bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:15.403031 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f0c47-38be-4e93-9d7d-d1bc18898bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:15.404961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f0c47-38be-4e93-9d7d-d1bc18898bcf admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:15.488944 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1406/2819] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 05:25:15 2021] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:25:15.492872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409081b-1d53-4aaa-b443-d97e8c15e7d7 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:15.504538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409081b-1d53-4aaa-b443-d97e8c15e7d7 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:15.566306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f01c9-2f12-4c80-8e23-d276f34e65b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:15.566973 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f01c9-2f12-4c80-8e23-d276f34e65b2 admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:15.567256 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f01c9-2f12-4c80-8e23-d276f34e65b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:15.567533 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f01c9-2f12-4c80-8e23-d276f34e65b2 admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:15.568527 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f01c9-2f12-4c80-8e23-d276f34e65b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:15.570460 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f01c9-2f12-4c80-8e23-d276f34e65b2 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:15.690420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1414/2820] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 05:25:15 2021] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:25:15.694748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f0c47-38be-4e93-9d7d-d1bc18898bcf admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:15.705640 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f0c47-38be-4e93-9d7d-d1bc18898bcf admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:15.710186 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905495a1-aa5e-40e3-b4cd-a1bbc0bf9863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:15.710832 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905495a1-aa5e-40e3-b4cd-a1bbc0bf9863 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:15.711120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905495a1-aa5e-40e3-b4cd-a1bbc0bf9863 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:15.711429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905495a1-aa5e-40e3-b4cd-a1bbc0bf9863 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:15.712143 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905495a1-aa5e-40e3-b4cd-a1bbc0bf9863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:15.714396 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905495a1-aa5e-40e3-b4cd-a1bbc0bf9863 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:15.724429 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1407/2821] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:25:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:25:15.728406 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f01c9-2f12-4c80-8e23-d276f34e65b2 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:15.738294 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f01c9-2f12-4c80-8e23-d276f34e65b2 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:15.743036 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847084b5-00e6-46fb-b70b-fe7f8bd437f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:15.743682 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847084b5-00e6-46fb-b70b-fe7f8bd437f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:15.743965 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847084b5-00e6-46fb-b70b-fe7f8bd437f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:15.744238 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847084b5-00e6-46fb-b70b-fe7f8bd437f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:15.745057 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847084b5-00e6-46fb-b70b-fe7f8bd437f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:15.746645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847084b5-00e6-46fb-b70b-fe7f8bd437f5 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:15.756154 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1415/2822] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:25:15 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:25:15.760601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905495a1-aa5e-40e3-b4cd-a1bbc0bf9863 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:15.770221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905495a1-aa5e-40e3-b4cd-a1bbc0bf9863 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:15.774733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f952430-05f4-47d1-8e7d-34620fe1f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:15.776387 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f952430-05f4-47d1-8e7d-34620fe1f5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:15.776682 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f952430-05f4-47d1-8e7d-34620fe1f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:15.776961 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f952430-05f4-47d1-8e7d-34620fe1f5a4 admin admin] PATH_INFO: `/v3/projects/af5055f516754787b32cb6b60eae1f52/users/56b8ed43e3b14bcb87c240e8e01f08c2/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:15.800817 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f952430-05f4-47d1-8e7d-34620fe1f5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5055f516754787b32cb6b60eae1f52, user_id=56b8ed43e3b14bcb87c240e8e01f08c2, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:15.803451 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f952430-05f4-47d1-8e7d-34620fe1f5a4 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:15.878719 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1408/2823] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:25:15 2021] PUT /identity/v3/projects/af5055f516754787b32cb6b60eae1f52/users/56b8ed43e3b14bcb87c240e8e01f08c2/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:25:15.889400 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129c40c-6604-4268-b30b-0d532059ea46 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:15.889694 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129c40c-6604-4268-b30b-0d532059ea46 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:15.892609 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129c40c-6604-4268-b30b-0d532059ea46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:15.915926 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b129c40c-6604-4268-b30b-0d532059ea46 None None] MFA Rules not processed for user `56b8ed43e3b14bcb87c240e8e01f08c2`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:25:15.917175 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b129c40c-6604-4268-b30b-0d532059ea46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:15.977178 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1416/2824] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:25:15 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:25:15.987665 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f952430-05f4-47d1-8e7d-34620fe1f5a4 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:15.989427 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8f952430-05f4-47d1-8e7d-34620fe1f5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:16.043234 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f952430-05f4-47d1-8e7d-34620fe1f5a4 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:16.046920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3f1d-8e97-4683-b27e-358317122f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:16.047591 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3f1d-8e97-4683-b27e-358317122f59 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:16.047878 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3f1d-8e97-4683-b27e-358317122f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:16.048156 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3f1d-8e97-4683-b27e-358317122f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:16.056340 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3f1d-8e97-4683-b27e-358317122f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:16.058309 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3f1d-8e97-4683-b27e-358317122f59 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:16.067000 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1409/2825] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:25:15 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:25:39.788106 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129c40c-6604-4268-b30b-0d532059ea46 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:39.848071 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129c40c-6604-4268-b30b-0d532059ea46 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:39.852671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:39.854073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:39.854360 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:39.854639 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] PATH_INFO: `/v3/users/56b8ed43e3b14bcb87c240e8e01f08c2` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:39.855816 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b8ed43e3b14bcb87c240e8e01f08c2)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:39.857821 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:40.034504 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b8ed43e3b14bcb87c240e8e01f08c2'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:40.035075 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b8ed43e3b14bcb87c240e8e01f08c2'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:40.035671 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b8ed43e3b14bcb87c240e8e01f08c2'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:40.047596 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b8ed43e3b14bcb87c240e8e01f08c2'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:40.140310 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b8ed43e3b14bcb87c240e8e01f08c2'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:40.153091 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1417/2826] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:25:39 2021] DELETE /identity/v3/users/56b8ed43e3b14bcb87c240e8e01f08c2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:25:40.157668 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0fa3-356d-440e-b785-0ec6b5cf8f37 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:40.158103 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0fa3-356d-440e-b785-0ec6b5cf8f37 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:40.158221 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0fa3-356d-440e-b785-0ec6b5cf8f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:40.175808 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-eaed0fa3-356d-440e-b785-0ec6b5cf8f37 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:25:40.180440 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-eaed0fa3-356d-440e-b785-0ec6b5cf8f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:40.233249 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1410/2827] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:25:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:25:40.245962 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:40.247349 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:40.302271 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d52b0-fa42-415d-a128-4c673f30a73a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:40.305858 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16297e11-ed9c-4ab4-9bc9-5298d9a6183f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:40.306499 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16297e11-ed9c-4ab4-9bc9-5298d9a6183f service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:40.306779 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16297e11-ed9c-4ab4-9bc9-5298d9a6183f service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:40.307053 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16297e11-ed9c-4ab4-9bc9-5298d9a6183f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:40.315748 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16297e11-ed9c-4ab4-9bc9-5298d9a6183f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:40.317456 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16297e11-ed9c-4ab4-9bc9-5298d9a6183f service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:40.326619 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1418/2828] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:25:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:25:40.747963 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0fa3-356d-440e-b785-0ec6b5cf8f37 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:40.749421 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-eaed0fa3-356d-440e-b785-0ec6b5cf8f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:40.761967 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0fa3-356d-440e-b785-0ec6b5cf8f37 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:40.766580 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:40.767433 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:40.767708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:40.767975 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] PATH_INFO: `/v3/projects/af5055f516754787b32cb6b60eae1f52` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:40.769173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5055f516754787b32cb6b60eae1f52)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:40.773120 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:40.912320 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5055f516754787b32cb6b60eae1f52', 'request_id': 'req-a1e55343-5eb3-40cf-8810-1a100ca05b21'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:40.918194 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5055f516754787b32cb6b60eae1f52', 'request_id': 'req-a1e55343-5eb3-40cf-8810-1a100ca05b21'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:40.923407 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5055f516754787b32cb6b60eae1f52', 'request_id': 'req-a1e55343-5eb3-40cf-8810-1a100ca05b21'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:40.996338 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] The token cache is being invalidate because project af5055f516754787b32cb6b60eae1f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:25:40.996650 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:40.997258 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-a1e55343-5eb3-40cf-8810-1a100ca05b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:40.998755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1411/2829] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:25:40 2021] DELETE /identity/v3/projects/af5055f516754787b32cb6b60eae1f52 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:25:41.004345 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d85d-7fbe-4cfc-87fb-490b2257ec65 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:41.004803 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d85d-7fbe-4cfc-87fb-490b2257ec65 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:41.004900 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d85d-7fbe-4cfc-87fb-490b2257ec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:41.022215 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-4b14d85d-7fbe-4cfc-87fb-490b2257ec65 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:25:41.023392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-4b14d85d-7fbe-4cfc-87fb-490b2257ec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:41.081589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1419/2830] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:25:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:25:41.090628 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61259bb-8be6-433e-ba77-24a938171ed0 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:41.090920 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61259bb-8be6-433e-ba77-24a938171ed0 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:41.091205 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61259bb-8be6-433e-ba77-24a938171ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:41.109733 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-b61259bb-8be6-433e-ba77-24a938171ed0 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:25:41.110938 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-b61259bb-8be6-433e-ba77-24a938171ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:41.119257 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1412/2831] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:25:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:25:41.123320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14d85d-7fbe-4cfc-87fb-490b2257ec65 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:41.132918 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14d85d-7fbe-4cfc-87fb-490b2257ec65 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:41.138136 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90c5c-7f86-4dc5-8d4d-86cf94088814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:41.138780 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90c5c-7f86-4dc5-8d4d-86cf94088814 admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:41.139065 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90c5c-7f86-4dc5-8d4d-86cf94088814 admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:41.139369 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90c5c-7f86-4dc5-8d4d-86cf94088814 admin admin] PATH_INFO: `/v3/domains` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:41.140088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f90c5c-7f86-4dc5-8d4d-86cf94088814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73668) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:25:41.140440 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f90c5c-7f86-4dc5-8d4d-86cf94088814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:41.142050 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f90c5c-7f86-4dc5-8d4d-86cf94088814 admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:41.153347 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1420/2832] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 05:25:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:25:41.157526 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61259bb-8be6-433e-ba77-24a938171ed0 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:41.167273 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61259bb-8be6-433e-ba77-24a938171ed0 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:41.172047 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94d18a-3458-421b-b0c5-3e5908414af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:41.172727 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94d18a-3458-421b-b0c5-3e5908414af8 admin admin] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:41.173011 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94d18a-3458-421b-b0c5-3e5908414af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:41.173286 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94d18a-3458-421b-b0c5-3e5908414af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:41.173968 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94d18a-3458-421b-b0c5-3e5908414af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:41.175942 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94d18a-3458-421b-b0c5-3e5908414af8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:41.266501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1413/2833] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 05:25:41 2021] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:25:41.270559 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90c5c-7f86-4dc5-8d4d-86cf94088814 admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:41.280430 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90c5c-7f86-4dc5-8d4d-86cf94088814 admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:41.333650 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552cc0-e48d-470f-ba75-3049bb3e3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:41.334306 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552cc0-e48d-470f-ba75-3049bb3e3a6c admin admin] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:41.334589 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552cc0-e48d-470f-ba75-3049bb3e3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:41.334863 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552cc0-e48d-470f-ba75-3049bb3e3a6c admin admin] PATH_INFO: `/v3/users` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:41.335547 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f552cc0-e48d-470f-ba75-3049bb3e3a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:41.337495 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f552cc0-e48d-470f-ba75-3049bb3e3a6c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:41.414069 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1421/2834] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 05:25:41 2021] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:25:41.421737 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94d18a-3458-421b-b0c5-3e5908414af8 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:41.428569 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94d18a-3458-421b-b0c5-3e5908414af8 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:41.433789 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadfd27-9aae-4fd4-9f7e-2d4166c2fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:41.434440 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadfd27-9aae-4fd4-9f7e-2d4166c2fdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:41.434722 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadfd27-9aae-4fd4-9f7e-2d4166c2fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:41.434998 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadfd27-9aae-4fd4-9f7e-2d4166c2fdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:41.435711 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadfd27-9aae-4fd4-9f7e-2d4166c2fdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:41.437332 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadfd27-9aae-4fd4-9f7e-2d4166c2fdb8 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:41.447547 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1414/2835] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:25:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:25:41.453114 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552cc0-e48d-470f-ba75-3049bb3e3a6c admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:41.463073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552cc0-e48d-470f-ba75-3049bb3e3a6c admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:41.467712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a90b-fc0c-4d34-849c-ebedc393933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:41.468370 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a90b-fc0c-4d34-849c-ebedc393933f admin admin] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:41.468659 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a90b-fc0c-4d34-849c-ebedc393933f admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:41.468935 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a90b-fc0c-4d34-849c-ebedc393933f admin admin] PATH_INFO: `/v3/roles` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:41.469646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a90b-fc0c-4d34-849c-ebedc393933f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:41.471234 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a90b-fc0c-4d34-849c-ebedc393933f admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:41.481426 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1422/2836] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 05:25:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:25:41.488042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadfd27-9aae-4fd4-9f7e-2d4166c2fdb8 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:41.498552 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadfd27-9aae-4fd4-9f7e-2d4166c2fdb8 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:41.503274 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce507b62-1e23-48a8-858f-b2d034318052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:41.504176 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce507b62-1e23-48a8-858f-b2d034318052 admin admin] REQUEST_METHOD: `PUT` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:41.504499 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce507b62-1e23-48a8-858f-b2d034318052 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:41.504775 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce507b62-1e23-48a8-858f-b2d034318052 admin admin] PATH_INFO: `/v3/projects/778772cb6edf4ef99ed0fbabe4105b6f/users/75304a57ace54d1d8a0b991bd2627357/roles/70600290909e4c808126b1efb2142b05` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:41.518901 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce507b62-1e23-48a8-858f-b2d034318052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778772cb6edf4ef99ed0fbabe4105b6f, user_id=75304a57ace54d1d8a0b991bd2627357, role_id=70600290909e4c808126b1efb2142b05)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:41.521675 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce507b62-1e23-48a8-858f-b2d034318052 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:41.610984 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1415/2837] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 05:25:41 2021] PUT /identity/v3/projects/778772cb6edf4ef99ed0fbabe4105b6f/users/75304a57ace54d1d8a0b991bd2627357/roles/70600290909e4c808126b1efb2142b05 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:25:41.621524 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe636-7bfe-426d-908c-0cf382484935 None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:41.621812 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe636-7bfe-426d-908c-0cf382484935 None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:41.622088 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe636-7bfe-426d-908c-0cf382484935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:41.647212 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-a76fe636-7bfe-426d-908c-0cf382484935 None None] MFA Rules not processed for user `75304a57ace54d1d8a0b991bd2627357`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:25:41.648422 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a76fe636-7bfe-426d-908c-0cf382484935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:41.708586 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1423/2838] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:25:41 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:25:41.719285 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce507b62-1e23-48a8-858f-b2d034318052 admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:41.721003 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ce507b62-1e23-48a8-858f-b2d034318052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:41.775755 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce507b62-1e23-48a8-858f-b2d034318052 admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:41.779404 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0aca-cdc8-4eb9-bfa7-db5bb2824af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c711b68b32a7435a93b12553972f9f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:41.780042 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0aca-cdc8-4eb9-bfa7-db5bb2824af6 service cinder] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:41.780326 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0aca-cdc8-4eb9-bfa7-db5bb2824af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:41.780633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0aca-cdc8-4eb9-bfa7-db5bb2824af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:41.788673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee0aca-cdc8-4eb9-bfa7-db5bb2824af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:41.790086 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee0aca-cdc8-4eb9-bfa7-db5bb2824af6 service cinder] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:41.799297 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1416/2839] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:25:41 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:25:46.070809 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe636-7bfe-426d-908c-0cf382484935 None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:46.196972 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe636-7bfe-426d-908c-0cf382484935 None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:46.201458 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:46.202319 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:46.202600 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:46.202871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] PATH_INFO: `/v3/users/75304a57ace54d1d8a0b991bd2627357` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:46.204040 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=75304a57ace54d1d8a0b991bd2627357)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:46.206018 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:46.410392 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75304a57ace54d1d8a0b991bd2627357'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:46.410996 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75304a57ace54d1d8a0b991bd2627357'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:46.411588 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75304a57ace54d1d8a0b991bd2627357'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:46.422724 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75304a57ace54d1d8a0b991bd2627357'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:46.502061 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75304a57ace54d1d8a0b991bd2627357'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:46.514303 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1424/2840] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:25:46 2021] DELETE /identity/v3/users/75304a57ace54d1d8a0b991bd2627357 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:25:46.518908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206f558-dc3f-43ef-832e-2aaebb8451f2 None None] REQUEST_METHOD: `POST` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:46.519411 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206f558-dc3f-43ef-832e-2aaebb8451f2 None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:46.519508 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206f558-dc3f-43ef-832e-2aaebb8451f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:46.537118 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.auth.core [None req-8206f558-dc3f-43ef-832e-2aaebb8451f2 None None] MFA Rules not processed for user `a3eedbef815445d78eda15afd8ed2501`. Rule list: `[]` (Enabled: `True`). {{(pid=73667) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:25:46.538311 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8206f558-dc3f-43ef-832e-2aaebb8451f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:46.593529 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1417/2841] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 05:25:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:25:46.603304 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:46.604689 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:46.663627 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6bfdf-e592-4437-bec7-192dd918f8eb admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:46.667302 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dece85-e55c-441a-8259-ec65694d7628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:46.667942 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dece85-e55c-441a-8259-ec65694d7628 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:46.668226 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dece85-e55c-441a-8259-ec65694d7628 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:46.668538 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dece85-e55c-441a-8259-ec65694d7628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:46.678166 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dece85-e55c-441a-8259-ec65694d7628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:46.680916 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dece85-e55c-441a-8259-ec65694d7628 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:46.694556 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1425/2842] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:25:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:25:47.190102 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206f558-dc3f-43ef-832e-2aaebb8451f2 None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:25:47.191916 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8206f558-dc3f-43ef-832e-2aaebb8451f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:25:47.205763 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206f558-dc3f-43ef-832e-2aaebb8451f2 None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:25:47.211457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:25:47.212366 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:25:47.212662 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:25:47.212939 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] PATH_INFO: `/v3/projects/778772cb6edf4ef99ed0fbabe4105b6f` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:25:47.214131 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=778772cb6edf4ef99ed0fbabe4105b6f)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:25:47.216125 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:25:47.353336 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778772cb6edf4ef99ed0fbabe4105b6f', 'request_id': 'req-3243e853-bb4a-474d-9bde-0094bfdf2cb3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:47.359317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778772cb6edf4ef99ed0fbabe4105b6f', 'request_id': 'req-3243e853-bb4a-474d-9bde-0094bfdf2cb3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:47.364724 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778772cb6edf4ef99ed0fbabe4105b6f', 'request_id': 'req-3243e853-bb4a-474d-9bde-0094bfdf2cb3'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:47.482172 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] The token cache is being invalidate because project 778772cb6edf4ef99ed0fbabe4105b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73667) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:25:47.482403 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:47.483021 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-3243e853-bb4a-474d-9bde-0094bfdf2cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:25:47.484600 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1418/2843] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:25:47 2021] DELETE /identity/v3/projects/778772cb6edf4ef99ed0fbabe4105b6f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:26:52.319593 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dece85-e55c-441a-8259-ec65694d7628 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:26:52.328913 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dece85-e55c-441a-8259-ec65694d7628 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:26:52.374469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c4495-6fe5-419f-83e8-3026430adbce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:26:52.375103 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4495-6fe5-419f-83e8-3026430adbce service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:26:52.375420 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4495-6fe5-419f-83e8-3026430adbce service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:26:52.375695 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4495-6fe5-419f-83e8-3026430adbce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:26:52.377454 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-945c4495-6fe5-419f-83e8-3026430adbce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:26:52.401873 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c4495-6fe5-419f-83e8-3026430adbce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:26:52.403329 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c4495-6fe5-419f-83e8-3026430adbce service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:26:52.413679 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1426/2844] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:26:52 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:27:28.055074 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe8ab-4096-4c41-9d99-7ab0880d072e None None] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:27:28.055664 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe8ab-4096-4c41-9d99-7ab0880d072e None None] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:27:28.055750 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe8ab-4096-4c41-9d99-7ab0880d072e None None] PATH_INFO: `/` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:27:28.057634 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1419/2845] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 05:27:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 05:27:28.063919 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569c48-2907-42e1-aa0e-d56f5ce6839f None None] REQUEST_METHOD: `POST` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:27:28.064404 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569c48-2907-42e1-aa0e-d56f5ce6839f None None] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:27:28.064501 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569c48-2907-42e1-aa0e-d56f5ce6839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:27:28.111438 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.auth.core [None req-b4569c48-2907-42e1-aa0e-d56f5ce6839f None None] MFA Rules not processed for user `a95d2eadd8c7455bb70477e4522c74c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73668) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:27:28.112678 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b4569c48-2907-42e1-aa0e-d56f5ce6839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:27:28.124509 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1427/2846] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 05:27:28 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:27:28.132992 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfe8ab-4096-4c41-9d99-7ab0880d072e None None] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:27:28.134748 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-ddcfe8ab-4096-4c41-9d99-7ab0880d072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:27:28.148025 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfe8ab-4096-4c41-9d99-7ab0880d072e None None] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:27:28.151602 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2c99d-dd64-42a4-9dc5-f8ff0bfdb887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:27:28.152240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2c99d-dd64-42a4-9dc5-f8ff0bfdb887 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:27:28.152565 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2c99d-dd64-42a4-9dc5-f8ff0bfdb887 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:27:28.152843 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2c99d-dd64-42a4-9dc5-f8ff0bfdb887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:27:28.159851 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2c99d-dd64-42a4-9dc5-f8ff0bfdb887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:27:28.161827 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2c99d-dd64-42a4-9dc5-f8ff0bfdb887 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:27:28.170140 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1420/2847] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:27:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:27:57.623995 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4569c48-2907-42e1-aa0e-d56f5ce6839f None None] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:27:57.625411 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-b4569c48-2907-42e1-aa0e-d56f5ce6839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:27:57.752296 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4569c48-2907-42e1-aa0e-d56f5ce6839f None None] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:27:57.757320 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fab778-09b7-43ed-826f-5025ec239b92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:27:57.757966 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fab778-09b7-43ed-826f-5025ec239b92 service placement] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:27:57.758244 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fab778-09b7-43ed-826f-5025ec239b92 service placement] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:27:57.758514 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fab778-09b7-43ed-826f-5025ec239b92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:27:57.760242 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-98fab778-09b7-43ed-826f-5025ec239b92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:27:57.771169 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fab778-09b7-43ed-826f-5025ec239b92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:27:57.772872 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fab778-09b7-43ed-826f-5025ec239b92 service placement] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:27:57.782428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1428/2848] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:27:57 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:29:01.602453 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2c99d-dd64-42a4-9dc5-f8ff0bfdb887 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:29:01.603999 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-52b2c99d-dd64-42a4-9dc5-f8ff0bfdb887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:29:01.681841 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2c99d-dd64-42a4-9dc5-f8ff0bfdb887 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:29:01.689050 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e2de0-d2a9-47e4-b893-cc04da144e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812bbce1050419ea721a9b648b87bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:29:01.689704 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e2de0-d2a9-47e4-b893-cc04da144e84 service nova] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:29:01.689994 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e2de0-d2a9-47e4-b893-cc04da144e84 service nova] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:29:01.690444 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e2de0-d2a9-47e4-b893-cc04da144e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:29:01.692229 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-739e2de0-d2a9-47e4-b893-cc04da144e84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:29:01.705029 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e2de0-d2a9-47e4-b893-cc04da144e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:29:01.706708 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e2de0-d2a9-47e4-b893-cc04da144e84 service nova] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:29:01.717594 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1421/2849] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:29:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:29:02.072252 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fab778-09b7-43ed-826f-5025ec239b92 service placement] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:29:02.082646 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fab778-09b7-43ed-826f-5025ec239b92 service placement] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:29:02.086786 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2316a-6d1e-4c85-8c5f-ad4ffee41dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:29:02.087428 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2316a-6d1e-4c85-8c5f-ad4ffee41dcd service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:29:02.087712 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2316a-6d1e-4c85-8c5f-ad4ffee41dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:29:02.088012 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2316a-6d1e-4c85-8c5f-ad4ffee41dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:29:02.089845 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-a3e2316a-6d1e-4c85-8c5f-ad4ffee41dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:29:02.103986 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2316a-6d1e-4c85-8c5f-ad4ffee41dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:29:02.105458 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2316a-6d1e-4c85-8c5f-ad4ffee41dcd service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:29:02.118125 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1429/2850] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:29:02 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:29:03.360599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e2de0-d2a9-47e4-b893-cc04da144e84 service nova] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:29:03.362102 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-739e2de0-d2a9-47e4-b893-cc04da144e84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:29:03.373940 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e2de0-d2a9-47e4-b893-cc04da144e84 service nova] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:29:03.377535 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619216e-7fb5-47a2-91e6-07a0fc4e1872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:29:03.378173 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619216e-7fb5-47a2-91e6-07a0fc4e1872 service neutron] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:29:03.378457 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619216e-7fb5-47a2-91e6-07a0fc4e1872 service neutron] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:29:03.378739 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619216e-7fb5-47a2-91e6-07a0fc4e1872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:29:03.380456 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-2619216e-7fb5-47a2-91e6-07a0fc4e1872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:29:03.393170 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619216e-7fb5-47a2-91e6-07a0fc4e1872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:29:03.394574 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619216e-7fb5-47a2-91e6-07a0fc4e1872 service neutron] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:29:03.405405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1422/2851] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:29:03 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:29:07.707877 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2316a-6d1e-4c85-8c5f-ad4ffee41dcd service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:29:07.716907 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2316a-6d1e-4c85-8c5f-ad4ffee41dcd service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:29:07.720888 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585fa22-f3d4-4fc1-9a93-ceafde893bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95d2eadd8c7455bb70477e4522c74c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:29:07.730407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585fa22-f3d4-4fc1-9a93-ceafde893bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:29:07.730407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585fa22-f3d4-4fc1-9a93-ceafde893bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:29:07.730407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585fa22-f3d4-4fc1-9a93-ceafde893bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:29:07.730407 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-5585fa22-f3d4-4fc1-9a93-ceafde893bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:29:07.814720 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585fa22-f3d4-4fc1-9a93-ceafde893bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:29:07.816168 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585fa22-f3d4-4fc1-9a93-ceafde893bf9 service neutron] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:29:07.836835 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1430/2852] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:29:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:29:13.566441 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619216e-7fb5-47a2-91e6-07a0fc4e1872 service neutron] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:29:13.567913 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-2619216e-7fb5-47a2-91e6-07a0fc4e1872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:29:13.582185 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619216e-7fb5-47a2-91e6-07a0fc4e1872 service neutron] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:29:13.586611 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:29:13.587566 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:29:13.587845 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:29:13.588116 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] PATH_INFO: `/v3/users/daa43240be34453a8090767848538c99` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:29:13.589353 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa43240be34453a8090767848538c99)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:29:13.591240 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:29:13.734524 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa43240be34453a8090767848538c99'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:13.746659 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa43240be34453a8090767848538c99'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:13.747317 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa43240be34453a8090767848538c99'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:13.754470 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa43240be34453a8090767848538c99'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:13.845370 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa43240be34453a8090767848538c99'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:13.851729 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1423/2853] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:29:13 2021] DELETE /identity/v3/users/daa43240be34453a8090767848538c99 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:29:14.071219 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585fa22-f3d4-4fc1-9a93-ceafde893bf9 service neutron] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:29:14.081078 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585fa22-f3d4-4fc1-9a93-ceafde893bf9 service neutron] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:29:14.134666 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:29:14.135518 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:29:14.135796 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:29:14.136073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] PATH_INFO: `/v3/projects/e871b7bc06b6412697156920cbc3f504` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:29:14.137263 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e871b7bc06b6412697156920cbc3f504)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:29:14.139167 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:29:14.240652 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e871b7bc06b6412697156920cbc3f504', 'request_id': 'req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:14.287181 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e871b7bc06b6412697156920cbc3f504', 'request_id': 'req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:14.293565 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e871b7bc06b6412697156920cbc3f504', 'request_id': 'req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:14.304482 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] The token cache is being invalidate because project e871b7bc06b6412697156920cbc3f504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:29:14.304777 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:14.305402 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:14.307255 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1431/2854] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:29:14 2021] DELETE /identity/v3/projects/e871b7bc06b6412697156920cbc3f504 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:29:14.311959 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:29:14.313638 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:29:14.326908 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399d4ff-f59f-4e0b-b903-f249e1e5077a admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:29:14.383132 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:29:14.384005 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:29:14.384288 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:29:14.384601 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] PATH_INFO: `/v3/users/f5548bbc932e4734a5c0dd34bb34ef27` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:29:14.385785 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5548bbc932e4734a5c0dd34bb34ef27)` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:29:14.387790 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:29:14.556673 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5548bbc932e4734a5c0dd34bb34ef27'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:14.568621 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5548bbc932e4734a5c0dd34bb34ef27'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:14.569915 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5548bbc932e4734a5c0dd34bb34ef27'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:14.576911 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5548bbc932e4734a5c0dd34bb34ef27'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:14.669599 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.notifications [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5548bbc932e4734a5c0dd34bb34ef27'} {{(pid=73667) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:14.675548 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1424/2855] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 05:29:14 2021] DELETE /identity/v3/users/f5548bbc932e4734a5c0dd34bb34ef27 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:29:14.923473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] Authenticating user token {{(pid=73668) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:29:14.923473 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.fernet_utils [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73668) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:29:14.935645 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362f9c4-35ff-431f-8ca6-3a1d26ae735a admin admin] Validating token access rules against request {{(pid=73668) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:29:14.989019 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3eedbef815445d78eda15afd8ed2501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c22cecb66d4652809a04ec1798ad5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73668) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:29:14.989865 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:29:14.990151 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] SCRIPT_NAME: `/identity` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:29:14.990429 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] PATH_INFO: `/v3/projects/033575ce14db453dbce3078e9ce6e17a` {{(pid=73668) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:29:14.992103 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] RBAC: Authorizing `identity:delete_project(project_id=033575ce14db453dbce3078e9ce6e17a)` {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:29:14.994073 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] RBAC: Authorization granted {{(pid=73668) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:29:15.102871 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033575ce14db453dbce3078e9ce6e17a', 'request_id': 'req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:15.166561 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033575ce14db453dbce3078e9ce6e17a', 'request_id': 'req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:15.172663 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033575ce14db453dbce3078e9ce6e17a', 'request_id': 'req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c'} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:15.184603 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] The token cache is being invalidate because project 033575ce14db453dbce3078e9ce6e17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73668) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:29:15.184839 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:15.185469 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: DEBUG keystone.notifications [None req-eb3eea9a-b20c-454a-bfc7-7d9c26a6724c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73668) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:29:15.187020 dv-cinder-778193-4-iscsi devstack@keystone.service[73668]: [pid: 73668|app: 0|req: 1432/2856] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 05:29:14 2021] DELETE /identity/v3/projects/033575ce14db453dbce3078e9ce6e17a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:33:03.664496 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] Authenticating user token {{(pid=73667) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:33:03.665904 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:33:03.744500 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640afb38-8e57-4a6a-87d6-089f4ea8e51f admin admin] Validating token access rules against request {{(pid=73667) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:33:03.805293 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb0bff-eebf-4d14-94f1-9feb287c73d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ef904ebfd2c4372b169ba7804278f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a605db043af542fd87b9365bb010b38d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73667) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:33:03.806009 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb0bff-eebf-4d14-94f1-9feb287c73d0 service placement] REQUEST_METHOD: `GET` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:33:03.806230 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb0bff-eebf-4d14-94f1-9feb287c73d0 service placement] SCRIPT_NAME: `/identity` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:33:03.806501 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb0bff-eebf-4d14-94f1-9feb287c73d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73667) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:33:03.808488 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.fernet_utils [None req-78fb0bff-eebf-4d14-94f1-9feb287c73d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73667) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:33:03.821949 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb0bff-eebf-4d14-94f1-9feb287c73d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:33:03.823633 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb0bff-eebf-4d14-94f1-9feb287c73d0 service placement] RBAC: Authorization granted {{(pid=73667) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:33:03.834405 dv-cinder-778193-4-iscsi devstack@keystone.service[73667]: [pid: 73667|app: 0|req: 1425/2857] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 05:33:03 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)